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(57) Abstract: A massively distributed processing 
system and associated methods are disclosed that 
provide a processing architecture for utilizing a 
multitude of widely distributed devices to process 
distributed project workloads. To provide the 
processing infrastructure, a client agent program, 
which may include a system component and a separate 
project component, operates on the distributed devices 
to process woridoads. For different projects, different 
project components may be provided to ran on the base 
system component. In addition, a device capabilities 
database and an incentive database can be' used by the 
server system to facilitate operations and encburage 
participation by client systems. Other databases may 
also be utilized to enhance system operations and 
functionality. And a wide variety of applications are 
possible, including network site testing, network site 
indexing, distributed data back-up, file sharing, data 
catching, data conversion, and scientific research, as 
well as many other distributed projects. 
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MASSIVELY DISTIUBIJTED PROCESSING SYSTEM 
AND ASSOCIATED METHODS 

Inventors: Edward A. Hubbard and Sriram S. Mandyam 

Technical Field of the Invention 

This invention , relates to distributing processing and more particularly to techniques and 
related mediods for mmaging, fecilitating and inq>Iementing distributed processing in a network 
enviroiunent 

Background 

Prior processing systems have included the technique of multiple users within a 
company sharing processing time available on a mainframe or central processing system. 
Using small segments of mainframe processmg tnne, departments wifliin the company would 
often incur costs associated with using the processing time, which in turn was billed back to 
each department from the central infonnation technology (IT) organization for Ae company. 
In other instances, a company could pay for and utilize processing time made available by 
third-party companies who possessed an over-capacity of mainframe processing power. 
These third-party companies would, in effect, create a market for the mainframe processing 
time that went unused by the internal organizatioiis of that third-party company. 

Prior processing techniques have also included distributed processing projects that 
have utilized the Intemeft or World Wide Web. These distributed processing research projects 
have used personal computers (PCs) connected to the Intemet to provide processing power to 
accompUsh research project goals. ResearchJ project goals have been, for example, 
identifying large prime numbers, analyzing radio^tekscope data, and ansdyzing code keys in 
an encryption deciphering contest 

One example of a distributed processiig project on Ae Intemet is a research project 
housed at the Universily of California at Berkeley to analyze sky recording data gathered by 
SET! (the Search far Exhateirestrial Latelligence); This sky recording data has been gathered 
for some time from the large Aiecibo Radio Telescope in Puerto Rico. The processing power 
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needed to analyze these data recordings was very large. At the peak of SETTs capture 
activities, SEH had accumulated over 100,000 years of signals to process, as measured by the 
compute power necessary to process all flie signals. To analyze this data, software was 
developed that could be downloaded to Internet connected PCs so that these PCs could 
process small sKces of these sky recordmgs. In under a year, this project, called SEn@home 
(URL in March 2000 - www.setiathome.ssLberkeley.edu) has completely processed this 
backlog of data and is now returning to the sTsy recording dataset for further processing tasks. 
This massively pariallel distributed system has a processing throughput of over 10 TFLOPs 
(terraFLOPS or 10*^ floating point operations per second) running on about 1.8 million 
Internet connected machines. 

Another example of a distributed processing technique was developed and 
implemented by Distributed.net (URL in March 2000 - www.distributed.net) to compete in 
enoyption breaking contests, Distributed.net created and distributed a client software 
program which may be downloaded by client systems connected to the Internet This client 
software then acts as part of a large distributed processing system specifically designed to 
bredc encrypted messages on flie lutemet. Usmg this processmg technique, Distributed.net 
has won enayption breaking contests sponsored by RSA Labs, which is an Internet security 
company. In tiiese contests, RSA Labs has offered a monetary prize to the winner of the 
encryption contest. Jn organizing its efforts, Distributed.net has offered a share of this 
monetary prize to the client system that actually breaks the encryption code. In addition, 
Distributed.net keeps track of overall project statistics, as well as statistics concerning the 
efforts of its client systems through individual and team rankings by amount of processing 
completed. 

Entropia.com (URL in March 2000 - www.entropia.com) has utilized an Internet 
distributed processing system to conq)ete in contests directed to identifying the largest prime 
number. Entropia.com also offers its computing power to other research projects. Users may 
sign on to be part of flie distributed processing fo^ free. For the largest prime number contest, 
Entropia.com, like Distributed.net, oflfers a monetary prize to flie Internet connected PC that 
comes up with the first prime number achieved in a new order of magnitude. For other 
research projects, the incentive is sinq)ly to be a part of the research project 
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AnoHier distributing piocessing web site is provided by Process Tree Network (URL 
in March 2000 - www.processJree.com). This web site is attempting to sign-up Internet 
connected computer systems to provide processing power for paying projects. For a project, 
each partner system, when connected to flie hiteniet, will have client software that downloads 
a job unit and processes that job unit The incentive offered by the Process Tree Network are 
"micro-payments** for the amount of work completed by any given system. These micro- 
payments are apparently small amounts of some total project value based upon the amount of 
Ae project completed by the given system through the jobs it has processed. In addition, each 
partner is given a bonus percentage of payments made to persons they sign-up as new 
partners. 

Li completely unrelated hitemet activities outside the distributed processing arena, 
there have been a number of sites that have utilized a sweepstakes model as an mcentive for 
consumer behavior. One of the most popular (ais of March 2000) sweepstakes sites is 
IW0N.COM (URL as of March 2000 - www.iwpn.com). IWON.COM is a standard Internet 
search and content portal that provides an mcditive to users by giving them entries to a 
sweepstakes when the users use the portal. The more the users use the portal, the more 
entries the user generates, up to a limit, for example, up to 100/day. At the end of each day, 
IW0N.COM chooses a $10,000 winner from among the entries. At the end of each month, 
IWON.COM chooses a $1,000,000 winner. And, at the end of an overall sweeps period, 
IW0N.COM plans to draw a single winner for a $10,000,000 grand prize. IWON.COM has 
created this sweepstakes model to introduce an Intemet portal in late 1999 and make it a web 
site that has as a comparable number of people using it as does Intemet portals that have 
existed for many years, such as, for example, Yahoo.com (URL in March 2000 - 
www.yahoo.cam). 

These prior distributed processing systems are narrowly focused on limited project 
activities and do not provide an efficient arcWtwture for utilizmg a distributed processing 
system to take foil advantage of distributed iBsources, managing those resources, and 
applying ttiose resources to solve a wide variety of distributed processing projects and 
problems. 
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Summary of the Invention 

The present invention provides a massively distributed processing system and associated 
methods that utilize an. advantageous processing architecture for utilizing a multitude of widely 
distributed devices to process distributed workloads for distributed processing projects. To provide 
the infiastructure processing power for the distributed processing system, a client agent program, 
including a system component with a core agent module and a separate project conq>onent with at 
least one task module, is configured to operate on ttie distributed devices and to process project 
workloads. For each different distributed project, different project components or task modules may 
be provided by a server sjrstem to the distributed devices to nm on the core agent module or system 
con:q)onent. hi addition, a capabilities database can be used by a servCT system to schedule 
woridoads based upon the capabilities of the distributed devices. And an incentive database can be 
used by a server system to store incentive values representing potential prizes or conq)ensation to ttie 
distributed devices for participating in &e distributed^processing system. Other databases can also be 
utilized to enhance or further add to system operations and functionality. FWhermore, a wide 
variety of plications are possible utili2dng Hbe distributed processing system of the present 
invention, including network site testing, networic^ site indexing, distributed data back-up, file 
sharing, data caching, data conversion, and scientific teseaich, as well as many other distributed 
projects. 

Description of the Drawings 

It is noted that the appended drawings illustrate only exemplary embodiments of the 
invention and are, therefore, not to be considered limiting of its scope, for the invention may admit to 
other equally effective embodiments. 

no. lA is a block diagram for a distributed processing system having client capability and 
incentive features, according to the present invention. 

FIG- IB is a block diagram for information flow among customer systems, server systems 
and cUent systems, according to the present inventioii. 

FIG. 2A is a block diagram for a client system, according to the present invention. 

FIG. 2B is a block diagram for processing elements within a client system, according to the 
presient invention. 
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FIG. 2C is a block diagram for a client system agent installed on a client system, according to 
the present invention. 

FIG. 2D is an example user interface for a cli^t system agent, including incentive 
S advertising, according to the present invention. 

FIG. 3A is a block diagram for server systems, according to the present inv^tion, including 
a control system, a sweepstakes system and a workload database. 

10 FIG. 3B is a block diagram for server systems, customer systems, client systems and 

outsourced host systems, according to the present invention. 

FIG. 3C is a block diagram for a sarva- system processor, acccnding to the present invention. 

15 FIG. 3D is an alternative block diagram for a server system processor, according to the 

present invention. 

FIG. 4 is a functional block diagram for an exanq)le sweepstakes incentive operation 
according to the present invention. 

20 

FIG. 5 A is a block diagram for a distributed processing system for a network site indexing 
application, according to the present inv^tion. 

FIG. SB is a functional block diagram for an indexing operation according to the present 
25 invention. 

FIG. 6A is a block diagram for a server system according to the present invention, including 
a control system, a worldoad database, and a database ofchent c^biUties balancing vectors. 

30 FIG. 6B is a functional block diagram for client capabilities balancing of workloads 

according to the present invention. 

FIG. 7A is a block diagram for a distributed processing system, according to the present 
invention, including example network sites on which site testing is to be conducted, such as load 
35 testing and/or quality-of-service(QoS) testing. 
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FIG. 7B is a functional block diagram for site-testing, according to the present invention. 

FIG. 8 is a block diagram of a distributed processing system for a data backiq> s^Iication, 
5 according to die present invention. 

FIG. 9 is a block diagram of an alternative representation of an interconnection &bric for a 
distributed processing system environment, according to the present invention. 

10 FIG. 10 is a block diagram of a more detailed block diagram for a client system agent 

installed on a client system, according to the present invention. 

FIG. IIA is a more detailed flow diagram for machine generated sweepstakes entries 
according to die present invention. 

15 

FIG. 1 IB is an alternative detailed flow diagram for machine generated sweepstakes entries 
according to the present invention. 

FIG. 12A is a block diagram of a distributed processing system Hhzt allows customers to 
20 select client systlran attributes, according to the present invention. 

FIG. 12B is a block flow diagram for client system attribute selection, according to the 
present inventioiL 

25 FIG. 13A is a block diagram of a distributed processing system that provides data conversion 

i 

services, according to the present invention. 

FIG. 13B is a block flow diagram for data conversion services within a distributed processing 
system, according to tiie present inventioiL 

30 

FIG. 14A is a block diagram of a distributed processing system that provides data 
transmission cadiing, according to the present inventioiL 

FIG. 14B is a block diagram of a distributed ph)cessing system that provides data sharing and 
35 file distribution, according to the present invention. 
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FIG. 15 is a block diagram of an alternative repiesentation for a distributed processing 
system, according to the present invention. 

5 FIG. 16 is a block diagram of a representation for a distributed processing system including 

security subsystems, according to the present invention. 

FIG. 17A is a block diagram of a client system and server systems communication interface, 
according to the prescmt inventioiL 

10 

FIG. 17B is a block diagram of communication layers for client system and server systems 
communication, according to die present invention. 

FIG. 18A is a detailed block diagram for an embodiment of security activities for server 
IS systems, according to the present invention. 

FIG. 18B is a detailed block diagram for an embodiment of security activities for client 
systems, according to the present invention. 

20 FIG. 19 is a block diagram for a distributed processing system and environment in vMch 

network service providers are enabled to monitize their user bases. 

FIG. 20 is a block diagram representing the components for a client agent along with a 
representative indication of responsibility for those components. 

25 DetaOed Description of the Invention 

The present invention contemplates the identification of the c^abilities of distributed 
devices connected together through a wide variety of communication systems and networks and tiie 
aggregation of these capabilities to accoir5)Iish processing, storage, broadcasting or any other desired 
project objective. For example, distributed devices connected to each otfier through the Internet, an 
30 intranet network, a wireless network, home networte, or any oflier network may provide any of a 
number of useful capabilities to third parties once their respective capabilities are identified, 
organized, and managed for a desired task. These distributed devices may be connected personal 
computer systems (PCs), intemet appliances, notebook c6nq)uters, servers, storage devices, network 
attached storage QiAS) devices, wireless devices, hand-held devices, or any other computing device 
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that has usefiil capabilities and is connected to a network in any manner. The present invention 
further contemplates providing an incentive, which may be based in part upon c^abilities of the 
distributed devices, to encourage users and owners of the distributed devices to allow the capabilities 
of the distributed devices to be utilized in the distributed parallel processing system of the present 
5 invention. 

The number of usable distributed devices contenqilated by flie present invention is preferably 
very large. Unlike a small local network environment, for example, as may be used by an Internet 
SCTvice Provider GSP), which may include less than 100 interconnected conn)uters systems to 

10 perform the tasks required by the ISP, the present invention preferably utilizes a multitude of widely 
distributed devices to provide a massively distributed processing system. With respect to tiie present 
invention, a multitude of distributed devices refers to greater than 1,000 different distributed devices. 
With respect to fhe present invention, widely distributed devices refers to a groiq> of interconnected 
devices of which at least two are physically located at least 100 miles ^art Widi respect to 

1 5 present invention, a massively distributed processing system is one fliat utilizes a multitude of widely 
distributed devices. The Internet is an example of a interconnected system fliat includes a multitude 
of widely distributed devices. An intranet system at a large corporation is an example of an 
mterconnected system that includes a multitude of distributed devices, and if multiple corporate sites 
are involved, may include a multitude of widely distributed devices. A distributed p-ocessing system 

20 according to &e present invention that utilizes such a multitude of widely distributed devices, as are 
available on the Internet or in a large corporate intranet, is a massively distributed processing system 
according to the present invention. 

FIG. 1 A is a block diagram for a distributed parallel processing system 100 according to the 
25 present invration. The network 102 is shown having a cloud outiine to indicate the unlimited and 
widely varying nature of the network and of attached client types. For examiple, the network 102 
may be the Internet, an internal company intranet, a local area network (LAN)» a wide, area network 
(WAN), a wireless hetwddc, a home netwoik or any other system that connects tog^ber multijple 
systems and devices. In addition, netwodc 102 may include any of fiiese types of connectivity 
30 systems by themselves or in combination, for exan^>le, conq>uter systems on a conqpany intranet 
connected to computer systems on the Intemet. 

FIG. lA also shows client systems 108, 110 ... 112 connected to the netwodc 102 through 
communication links 118, 120 ... 122, respectively. In addition, server systems 104, otibier syst^ns 
35 106, and customer systems 152 are connected to the netwoik 102 flirough communication links 1 14, 
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1 16 and 1 19, respectively. The client system capabilities blodc 124 is a subset of the server systems 
104 and represents a determination of the capabilities of flie client systems 108, 110 ... 112. The 
incentives block 126 is also a subset of flie server systems 104 and represents an incentive provided 
to the users or owners of the clients systems 108, 110 ... 112 for allowing c^abilities of the clients 
5 systems 108, 110 ... 112 to be utilized by the distributed processing systan 100. The client systems 
108, 110 and 112 represent any number of systems and/or devices that may be identified, organized 
and utilized by ttie server systems 104 to accomplish a desired task, for example, personal computer 
systems G*Cs), internet appliances, notebook conq>uters, servers, storage devices, network attached 
storage (NAS) devices, wireless devices, hand-held devices, or any oflier computing device that has 
10 useful cq>abilities and is connected to a network in any manner. The server systrais 104 represent 
any number of processing systems that provide flie function of identifying, organizing and utilizmg 
the client systems to achieve the desired tasks. 

The incOTtives jrovided by the incentives block 126 may be any desired incentive. For 
15 eTcanG^le, the incentive may be a sweq>stakes in whic^ entries are given to client systems 108, 110... 
112 fliat are signed up to be utilized by flie distributed processing system 100. Oflier exan^le 
incentives are reward systems, such as airline fiequent-flyer miles, purchase oredits and vouchers, 
payments of money, monetary prizes, property prizes, free trips, time-share rentals, cruises, 
cormectivity services, free or reduced cost Internet, access, domain name hosting, mail accounts, 
20 participation in significant research projects, achievCTient of personal goals, or any oflier desired 
incentive or reward. 

As indicated above, any number of other systems may also be connected to the network 102. 
The element 106, therefore, represents any numb^ of a variety of other systems that may be 

25 connected to the network 102. The oflier systems 106 may include ISPs, web servers, university 
computer systems, and any other distributed device connected to the network 102, for exaniple, 
personal conq>uter systems ^Cs), internet appliaiice^> notebook conqmters, servers, storage devices, 
network attached storage (NAS) devices, wireless dei^ces; hand-held devices, or any other connected 
conqjuting device that has useful capabilities and is; connected to a network in any maimer. The 

30 customer systems 152 represents customers fliat have projects for flie distributed processing system, 
as furflier described wifli respect to FIG. IB. The customer systems 152 connect to flie network 102 
tiirough die communication link 1 19. 

It is noted that the communication links 114, 116, 118, 119, 120 and 122 may allow for 
35 communication to occur, if desired, between aiqr of flie systems connected to the netwc»k 102. For 



-9- 



wo 01/73545 



PCTAJSOl/10060 



exanqple, client systems 108, 110 ... 112 may cominumcate directly with each other in peer-to-peer 
typo conununicatiocs. It is furtha- noted that the communication links 114, 116, 118, 119, 120 and 
122 may be any desired technique for connecting into any portion of the netwodc 102, such as, 
Ethernet connections, wireless connections, ISDN donnections, DSL connections, mod^ dial-iq) 
connections, cable mod^ connections, fiber optic connections, direct Tl or T3 connections, routers, 
portal computers, as well as any other network or communication connection. It is also noted that 
there are any number of possible configurations for flie connections for network 102, according to the 
present invention. The client system 108 may be, for exanq>le, an individual personal computer 
located in someone's home and may be coimected to the Intemet Arough an Internet Service 
Provider (ISP). Client system 108 may also be a personal con5)uter located on an employee's desk at 
a company that is connected to an intranet through a network router and flien connected to the 
Intemet through a second router or portal conq)uter. Client system 108 may further be personal 
conqniters connected to a company's intranet, and the server systems 104 may also be cormected to 
fliat same intranet In short, a wi(te variety of network edvironments are contemplated by the present 
invention on vviAcli a large number of potential client systems are cormected. 

FIG. IB is a block diagram for information iflow 150 among customer systems 152, server 
systems 104 and clioit system 134, according to fl)e present inventioa The server systems 104, as 
discussed above, may include any number of difTerent subsystems or conqx>nents, as desired, 
including cli^ system cq)abilities block 124 and incentives block 126. The serv^ systems 104 
send project and benchmark workloads 130 to client systems 134. A benchmark workload refers to a 
standard workload that may be used to determine the relative capabilities of the client systems 134. 
A project workload refers to a workload for a given project that is desired to be completed. The 
project workload may be, for example, a workload for projects such as network site content indexing, 
network site testing including network site load testing and network site quality of service testing, 
data back-i^, dmg design, drug interaction research, chemical reaction studies, bioinformatics 
including genetic and biological analyses, human gedimip analyses, pair-wise corrq>arisons including 
fing^rint and DNA sinalyses^ data miiing, internet hosting services, intranet hosting services, 
auction services, market clearing services, payment s^tems, bioinformatic simulatiotis, knowledge 
management services, trading services, data matching services, graphics rendering, or any other 
desired project 

Client systems 134, as discussed above, may be any number of differ^t systems that are 
connected to the server systems 104 through a network 102, sucsh as client systems 108, 110 ... 112 
in FIG. lA The client systems 134 send results 132 back to the server systems 104 after the client 
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systems 134 coiiq>lete processing any given woildoad. Dqp^ding upon the workload project, the 
server systems 104 may ihm provide results 156 to customer systems 152. The customer systons 152 
may be, for example, an entity that desires a given project to be undertaken, and if so, provides the 
project details and data 158 to the server systems 104; 

5 

FIG. 2A is a block diagram for an example client system 108 according to the present 
invention. In this simplified block diagram, an original workload 204 is received trough line 208 
from an interface 206. llie original woddoad 204 rq>resents a portion of the processing, storage or 
other activity required to complete the desired task for which the server system 104 is trying to 

10 accomplish. This original workload 204 is sent by the server system 104 througji the network 102 
and received by the client system 108 Orough coipmunication link 118. The client system 108 
processes the original woddoad 204. Following line 212, results 202 are flien stored fcxr transfetring 
along Ime 210 to inter&ce 206. Interface 206 may then communicate the results back to the server 
system 104 through communication line 118, or to odker client systnns (for example, with peering of 

15 client systems) and then througji the network 102. 

It is noted that the workload received by client system 108 and the processing or activity 
performed may depend up a variety of factors, as discussed further below, hi part, this workload 
allocated by the server system 104 to each client system 108, 110 and 112 may depend upon the 
20 capabilities of the client system, such as the processing power, disk storage capacity, 
communications types, and other c^>abilities available from the various compon^ts offhe systems 
within the cUent system 108. 

The server systems 104 can select the workloads for the client system 108 and may control 
25 when these workloads are performed, tbrou^ op»:atibnal code (i.e., an agent) residmg and installed 
on the client system 108. Alternatively, the owner or user of the client system 108 may determine 
when workloads are procured or obtained from the server systems 104, as well as when these 
workloads are performed, for example, by accessing the server systems 104 through the network 102. 
For example, the server syst^ns 104 may download to the client system 108 upon request one or 
30 more workloads. At the same time, an agent residing on the cli^t system 108 may operate to 
process the workload or multiple workloads downloaded to the client system 108. It is noted, 
therefore, that the agent may be simultaneously managing more than one workload for any number of 
projects. When the workload is complete, the agent may inform the owner or user of flie client 
system 108 the results are ready to be communicated back. The client system 108 inay thm upload 
35 results to the server system 104 and download new workloads, if desned. Alternatively, these 
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logistical and operational interactions may take place automatically throu^ control of flie agent 
and/or the server systems 104. 

FIG. 2B is a block diagram for processing elements within a client system 108 according to 
the presexft invention. In this diagnim, client system 108 is contemplated as a personal con^nter. In 
a personal computer, an internal, bus 260 would typically have a variety of different devices 
coimected to it. For example, a CPU 250 could be connected tfatougih the bus 260 to a video 
processor 252, a floating point processor 254 (often integrated within the CPU itself), and digital 
signal processors 256 (DSPs), such as those found on' sound cards and modems. In addition, any of a 
variety of other processing devices 258 may be included. Furthmnore, other types of devices may be 
connected, such as hard drives 264, which provide disk storage capabilities, and a digital camera 262. 

It is noted, therefore, that the c£q)abilities foi* client systems 108, 110 ... 112 may span the 
entire range of possible computing, processing, storage and other subsystems or devices fliat are 
connected to a system connected to the netwoik 102. For exanq)le, these subsystems or devices may 
include: central processing units (CPUs), digital signal processors (DSPs), graphics processing 
engines (GPEs), hard drives (HDs), memory (MEM), audio subsystems (ASs), communications 
subsystems (CSs), removable media types (RMs), and other accessories witii potentially useful 
unused capabilities (OAs). In short, for any given computer system connected to a network 102, 
tiiere exists a variety of capabilities that may be utilized by that system to accoiiq)lish its direct tasks. 
At any given time, however, only a fraction of these capabilities are typically used on the client 
systems 108, 110 ... 1 12. The present invention can take advantage of these unused c^abilities. 

It is also noted fliat alcmg with receiving the workload, the client system 108 will also receive 
an agent that manages the con9)letion of the woflddad. This agent may be software that is 
customized foir the particular con^uter system and processing c^abilities of the client system 108. 
For example, if die client system is a personal comiiuto: as shown in HG. 2B^ the agent may be a 
prograni that operates in the badcground of the compute's operatiiig systebn. When the ag^ 
determines that tiiece is unused processing or ofh^ caps^iilities, the ag^ may take advantage of it. 
For example, if the user is using a word processing plication to oreate a document, little processmg 
power is being utilized by the word i»ocessing program, leaving the conq>uter*s CPU and video 
processor underutilized. Thus, the agent could execute commands to these processors during dead 
cycles, in this way, the agent may &cflitate the completion of workload processing in a reduced 
time. In addition, this agent may be self-i^dating upon connecting to the servo: systems 104, so that 
the agent may be k^t up to date with current software revisions and workload activities. It is also 
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noted that be ag^nt may manage work on multiple m)i]doads at the same time, so that any given 
distributed device connected to the network 102 may be woiking on a plurality of woddoads at any 
given time. 

5 FIG. 2C is a block diagram for an exan^)le client system agent 270. The agent 270 may 

include a security subsystem 272 that controls the interface of the cli^t system 108 with the agent 
270. The security subsystem 272 may help keep the workloads secure and may help to keep the 
client systems 108 from suffering any security problems in conqileting the workload For example, 
the agent 272 may operate to keep viruses from attacking the client system 108 while the client 
10 system 108 is processing the workload through the operation of the agent The security subsystem 
272, therefore, may provide the intocface for flie workloads 130 and the results 132. 

The clients system agent 270 may also include a workload engine 274, a statistics / user 
inter&ce / incentive advertising block 276, and a woddoad package and xxpdato processing block 278. 

15 In the example shown in FIG. 2C, woddoads 130 pass through the security subsystem 272 and along 
line 280 to the workload package and update processing block 278. In this block 278, flie agent 270 
may be updated by the server systems 104. Alternatively, die agent 270 may determine, when 
connected to the server systems 104, whether it needs to be updated and tiien acconq>Iish tiiat 
i^dating automatically. Once die workload padkage is processed. Hie workload engine 274 may 

20 receive tiie workload following line 288. The workload engine 274 works on the workload, 
ultimately completing the workload. Hie results or status of the workload may then be sent through 
the security subsystem 272 following line 282. The results 132 may then be provided back to the 
server systems 104. 

25 The statistics / user inter&ce / incentive advertising block 276 may provide woddoad, 

incentive and other statistics, as well as any other desired inter&ce features, to the user of ttie client 
system. For example, die block 276 may show a user the expected ampt^ 
take for the client system to complete a worldoad ta^ based upon the capabilities of the system. As 
also shown, the block 276 may receive information following lines 286 and 284 fiom tiie workload 

30 package and update processing block 278 and from the workload engine 274. If desired, security 
information from die security subsystem 272 could also be displayed to die user of the client system. 
It is noted that die information displayed to die user of the client system may be modified and 
selected as desired without departing fiom the presenti^invCTttion. 
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With respect to incentive advertising, the bliock 276 may also show the user of the client 
system how this processing time mig|it change depending upon various possible upgrades to the 
oqpabilities of the client system, such as a faster microprocessor, more memory, more disk storage 
space, etc. Furthermore, the client system capabilities may be shown correlated to the incentives 
5 provided to tfie client system for participation. Thus, the user may be provided information as to how 
the user's incentives would increase or change depending iq>on other computer systems or ixpgraded 
c^abilities the user could acquire. This incentive value increase may also be tied to upgrades to 
particular vendor's devices. For exanq)le, if the user's device is a computer syst^ having an ABC 
micrc^rocessor, the block 276 may provide the us^ information as to increased incentive values 
10 based upon an vpgcade to a more powerfid ABC microprocessor. Similarly, if the user's device is a 
con^uter system obtained firom ABC, the block 276 may provide the user information as to increased 
incentive values based xspaa an upgrade to a more powerful ABC conq)uter system. 

i 

FIG. 2D is a an example user intec&ce 276 for a client system agent, includmg incentive 
IS advertising, according to the present invention. In the exan^le shown> inter&ce 276 is a window 230 
that may be displayed on a distributed device, for exancple, a computer system. This window 230 
displays the desired information for the agent client manager. As indicated above, this agent client 
manager is initially downloaded &om the server systems 104 and thereafter may be \q>dated at 
various times \^en the client s}«tem is communicating with the server systems. Hie inter&ce 276, 
20 as shown, includes inter&ce tabs 221, 222, 224, 226, 228, 244, 246 and 248. These inter&ce tabs 
may be selected through the user of a pointing device or k^board attached, for example, to a 
compute system graphically displaying the window 230. It is noted that the interface tabs 221, 222, 
224, 226, 228, 244, 246 and 248 are only examples, and the number, arrangement and content of tabs 
may be modified as desired. In addition, the example user inter&ce 276 depicted in FIG. 2D is only 
25 an example and may be modified as desired. 

In HG. 2D, the processor values inter&ce tab 224 is the one currently selected b^ 
This tab 224 (Processor Values) includes example ihfonnation that may be displayed to the user. 
Assuming that a workload is bring processed by the agent dient manager, the us^ may select the 
30 button 242 (Show My hicentive Values) to show the user's current incentive values associated with 
the workload being performed. The perspnal incec^tive values chart 232 (My Personal Incentive 
Values) may then be displayed to the user. As shown, tiie incentive values are provided in a relative 
scale fiom 1 to 10. Tlie key designation 240 represents the incentives associated with the users 
current central processing unit (CPU) or nuoroprocessor. 

35 
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As indicated above, this incentive infonnation may also be tied to the specific vendor of the 
user's CPU, for example, ABC Company's CPU. Thus, as shown, the key designation 240 (My 
current processor) and the con:esponding bar graph portion 236 represent incentives for the user's 
current CPU (e.g., a 166 MHz processor). The key designation 238 represents the incentives that the 
5 user is projected to have if the user were to i^grade the CPU. Again, this upgrade incentive 
information may be tied to the specific vendor of the user's CPU or to any other vendor, if desired. 
Thus, as shown, the key designation 238 (NEW ABC iGHz processor!) and the corresponding bar 
graph porticm 234 rq>resent incentives for an upgrade to a new ABC CPU (e.g., anew ^ 1 GHz 
processor). In this manner, a user may be provided an incentive to increase the capabilities of the 
10 . distributed device, and a vmdor may be provided advertising so that the user is also directed to a 
particular upgrade. 

Looking fiirther to FIG. 2D, other similar incentive related information tabs may be provided 
for any desired c^mbility of the distributed device. For example, tab 246 (Memc»ry Values) 

15 represents information that may be provided for tiie memory capabilities of tfie distributed device. 
Tab 222 (Graphics Values) rqsresents information that may be provided for the graphics capabilities 
of the distributed device. Tab 226 (Communications Values) represents information tiiat may be 
provided for the conmiunication capabilities of the distributed device. Tab 228 (Storage Values) 
represents information that may be provided for the storaige c^abilities of the distributed device. Tab 

20 248 (System Values) represents information that may be provided for the system capabilities as a 
whole for die distributed device. 

In addition to these incentive related infonnation tabs, other tabs may be included to provide 
information and control for any desired features of the agent client manager. For example, the tab 

25 244 (Current: Prime Search) represents infonnation that may be displayed to the user about the 
current workload being performed by ttie agpnt client, manager, for example, a search for large prime 
riumbers. The tab 221 (Settings) represents information that may be displayed to the user about 
various settings for the climt zgeitA inanager. In p^cular, the tab 221 may provide the u^er the 
ability to control any desired aspect of the operation of the ag^t client manager. For example, the 

30 user may be able to select a portion of the capabilities that may be utilized (e.g., a maximum of 20% 
of the system memory), &e types of workloads that may be performed (e.g., only scientific research 
projects), the times when the agent may utilize system resources (e.g., only between 12 to 6 am, or 
only when the system is idle), or any other desired operational feature. It is noted that in addition to 
upgrade incentive information indicated above, the user may also be provided information as to how 

35 incentives would increase if the user allocated or changed the settings for the agent client manager. 
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This user selection of operational features allows for workloads to be scheduled or balanced 
based upon user input and desires. These user vectors, as indicated above, would allow users to 
dedicate their device capabilities to specific research projects (cancer, Parkinson^s disease, Internet, 
5 genetics, space science, etc.), to specific non-profit cat fpr profit organizations (Greeiq>eace, Celera, 
etc.), educational institutions (University of Texas),ta specific groiq> of like minded users, or any 
other entity or endeavor. This afiSliation selection allows the distributed processing system to 
automatically include a user's device capabihties in a pool dedicated to the chosen afSliation. 
Additionally, a user could choose to mix various p^x^entages and allocations of device capabilities 

10 among multiple afBliations. It is noted that die user need not make any afOliation selection and need 
not allocate 100 percent of device capabilities. Rather, onfy a portion of the device capabilities may 
be allocated to a particular affiliation, leaving the r^nainder non-allocated and not affiliated. The 
C2q)ability allocation may also be a system-wide (i.e., course) allocation, such as some desired peiicent 
of ova:all device capabilities. The capabilities allocation may also be subsystem specific (i.e., fine) 

1 S allocation^ such as allocation of particular subsyst^ cq>abilities to particular affiliations. 

Now looking to FIG. 3 A, the server systems 104 may be one or more computer systems that 
operate to identify client syst^ c^bilities, organize woddoads, and utilize cUent systems to 
accomplish a desired task. The server systems l64 includes a control system 304 a workload 

20 database 308, and a sweepstakes system 306, as discussed more below. The workload database 308 
stores any desired project task, which may be broken up into discrete workload tasks WLl, WL2 ... 
WLN, as represented by elements 336, 338 ... 340. The workload database may also store one or 
more benchmark workloads (BWL) 335 that may be utilized to determine client system capabilities 
in response to a standard workload. Through line 312^ the workload database 308 communicates 

25 with control system 304. Control system 304, for example, receives original workload 322 and 
transfers it to the interface 320 through line 326. The interface 320 then transfers the workload 322 
to the network 102 througji line 1 14. This workload' 322 is ultimately received as workload 204 by 
client system 108, lid or 112, as shoW The result 324 is ultimately received by the 

control system 304 througji inter&ce 320 and line 328. 

30 

In allocating workloads, the control system ^04 may consider the capabilities of the client 
systems 108, 110 and 112 to which flie control system 304 is sending workloads. For exanq>le, if 
client 108 has more processing power than client 110, the control system 304 may allocate and send 
more difficult or larger workloads. Thus, client 108 may receive WLl 336 and WL2 338, while 
35 client 110 would only receive WL3. Alternatively, the workload database 308 could be orgaruzed 



-16- 



wo 01/73545 



PCT/USOl/10060 



with differing levels of processing power or capability requirements for each workload. In diis way, 
WLl 336 may represent a greater processing or system c^ability requirement than WL2 338. It 
should be noted that workload may be a processing task, a data storage task, or tied to any other of a 
variety of capabilities that may be utilized on the client systems 108, 1 10 . 112. 
5 , 

As indicated above, to encourage owners or users of client systems to allow their system 
capabilities to be utilized by control system 304, an incentive system may be utilized. This incentive 
system may be designed as desired. Incentives may <be provided to tiie user or owner of the clients 
systems when the client system is signed-tq[> to participate in Ihe distributed processing system, when 
10 the climt system con:q>letes a workload for the distributed processing system, or any other time 
during the process. In addition, incentives may be based upon the csqpabilities of tiie client systems, 
based iq>on a benchmark workload that provides a standardized assessment of the capabilities of the 
client systems, or based upon any other desired criterik. 

15 One example use of a benchmark workload is to use fte benchmark workload to determine 

incentive values. For example, the server systems 104 may be designed to send out a standard 
benchmark worldoad once an hour to each client system 108, 110 ... 112. If a client system is not 
available at that time for any reason, the workload wCnild not be completed by fhs client system, and 
there would be no incentive value generated for that client system. In this example, &e benchmark 

20 workload may be a timed work-set that would exercise eadi subsystem widi C2^)abilities within the 
client system that was desired to be measured. A rdore' enable client system would then generate 
greater incentive values fiom executing the benchmark woddoad, as compared to a less enable 
client system. These incentive values may be utilized as desired to determine what the client system 
should get in return for its efforts. For exanq)le, if the incentive were a sweepstakes as discussed 

25 further below, the number of mines in the sweq>stakes may be tied to fiie system^s performance of 
die benchmark woddoad. Thus, the &ster or better die client system performs fbe benchmark 
workload, die more entries die cli^t system would rebeive. 

In the embodiment shown in FIG. 3A, the server systems 104 includes a sweq)stakes system 
30 306 that functions with control system 304 to i»x>vide incentives fc»r die users or owners of client 
systems 108, 110 and 112 to allow dieu: system cai^ilities to be used by the server systems 104. 
The control sjfstem 304 may determine a sweepstake^ entry value 302 that is sent along line 310 to 
the sweepstakes system 306. The sweepstakes systm 306 may then receive sweepstakes entry 332 
and provide it to the sweepstakes engine 330 dirou^ line 334. The sweepstakes engine 330 may 
35 process the entries and determine a winner, when desired. In the embodiment shown, therefore, 

i 
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entries to the sweepstakes may be generated each time a unit of work is accomplished by one or more 
of the subsystems within a client system 108, 110 or 112 via an agmt installed on the device for the 
puiposes of managing and completing units of work. The total entries for any period of time would, 
therefore, be dynamic depending on how many are received Odds of winning would then be 
5 determined by the total number of entries received and the total number of entries contiibutable to 
any givai entrant. 

FIG. 3B is another example block diagram of a distributed processing system 300 including 
server systems 104, customer systems 152, client systems 134 and out-sourced host systems 340, 

10 according to flie present invention. The server systems 104 may include an analytic subsystem 346, a 
results/workload production subsystem 344, a project pre-processing subsystem 342, a client ag^t 
subsystem 343, and an mcentive advolising subsystem 345. The incentive advertising subsystem 345 
may operate to provide advertising information, for exanq)le, the upgrade incentive information as 
discussed with respect to FIG. 2D. The client ageiit subsystem 343 may operate to download an 

15 agent to die client systems 134 and to iq)date this agent at tnnes whoi the server systems 104 are 
communicating with the client systems 134. 

The customer systems 152, which rq)resent customers that have projects that they desired to 
be processed by the distributed processing system, ihay be connected to the project pre-processing 

20 subsystem 342 to provide projects to the server systems 104. These projects are processed by* the 
project pre-processing subsystem 342 and passed to the results/workloads production subsystem 344, 
which produces and sends out workloads 130 and recjeives back results 132. The analytic subsystem 
346 then takes the results and processes them as desired. Conq>leted project information may then be 
provided from the analytic system 346 to the customer syst^ns 152. In this manner, die projects of 

25 die customer systems 152 may be processed and project results reported by the distributed processing 
system of the present invention. 

Also, as shown, tfaib woridoads 130 and flie results 132, or othe 
104, may be processed and handled by out-sourced hdst ^steins 340, if desired Thus, some or all of 
30 the workloads 130 may be s^t first to out-sourced host systems 340. Out-sourced host systems 340 
dien send workloads 130A to the cU&at systems 134 ^ind receive back results 132A. The out-sourced 
host systems 340 then send die results 132 back to the server systems 104. It is noted that this out- 
sourcmg of server syst^ tasks may be inq>lemented as desired for any given task diat the server 
systems 104 may have. It is further noted that, if desired Ifae server systems 104 may perform all of 
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the desired functions of the server systems 104 so that no out-sourced host systems 340 would be 
used. 

FIG. 3C is a block diagram for one embodinient of a server system processor 350, according 
5 to the present mvention. An agent abstraction layer 360 may send workloads 130 and receive results 
132. The security subsystem 354 may interact wifli the agent abstraction layer 360 and provide 
information to a data parser 352 and an application programming inter&ce (APIs) block 356. The 
APIs block 356, the data parser 352 and a woridoad manager 358 may interact to accomplish the 
desired tasks for the server system processor 350. It is noted that for this embodiment, the API 
10 protocol could be controlled and provided to other host systems. 

FIG. 3D is an alternative block diagram for a server system processor 350, according to the 
present inventioiL In fbis embodiment, &e APIs block 356 and the agent abstraction layer 360 are 
not present The data parser 352, flie woddoad manager 358 and the security subsystem 354 interact 
15 to provide the desired server system tasks. It is noted that for this embodiment, the security 
subsystem is controlled and utilized for communicating with client systems. 

FIG. 4 is a functional block diagram for a sweepstakes operation 400 by the system server 
104 according to the present invention. In block 402, . the server systems 104 may sign-up client 

20 systems in "accept clients" block 402. Following line 418, the server systrais 104 identifies the 
capabilities of the client's computer and processmg systems in the "determine client system 
capabilities" block 404. Control passes along line 420 to the "distribute workloads to client systems" 
block 406, where the server systems 104 allocates workloads to each client system 108, 1 10 and 1 12. 
This workload may also be an benchmark workload, as indicated above, that acts as an entry 

25 workload to determine the entries or entry values for the client system. As also indicated above, in 
distributing the workloads in block 406, the server system 104 may take into consideration the 
capabilities of the iclient systems to which workloads are being distributed The client systems 108, 
110 and 1 12 fhesa operate to conq>lete the worldoads allocated to them. Along line 423, the server 
system 104 receives back workload results in "receiv4 workload results" block 408. 

30 -i - 

At this point, control passes along line 424 to.the "determine sweepstakes entries" block 410. 
In this block 410, the servo: system 104 determines the entry value for the workload completed or for 
a standard benchmark or entry workload completed. This entry value may be weighted upon a 
yarie^ of &ctors including &ctors such as the amount of work conqDleted, the difiScuIty level of the 

35 processing required, and the accuracy of the results. It is noted that any desired weighting may be 
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utilized. Thus, it is undeistood that a wide variety of considerations may be utilized to detomine the 
entry value weighting for the sweq)stakes. 

Although the wei^ting detennimtion is shown in block 410 in FIG. 4, the entry value may 
5 also be determined, in whole or in part, when a client syst&m signs on to the distributed processing 
distributed system of the present invention. For exaiipl^, if a client system has state-of-the-ait CPU, 
video processor, DSP engme, memory, and large amounts of free disk storage space, a high entry 
vjdue may be allocated to this clioit system iq?-froiit hi contrast, a client system that has a slow 
CPU, a weak video processor, no DSP engine, little memory, and little free disk storage space may be 
10 allocated a small entry value. In this way, the owneris or users of the client systems may be provided 
immediate feedback as to the potential sweepstakes entry value of then: computer systems, devices 
and system capabiUties. 

It is fiirther noted that Ae entry value may take any desired form and naay be, for exai^ 
15 multiplier that will be used for each unit of workload completed. Inthis way, the owner or user will 
readily be cognizant that a state-of-the-art system Will yield a high multiplier, where as an older 
system, system capability or device will yield a low ntultiplier. Such feedback, whether 
communicated to the owner or user immediately upon signmg up or upon completion of each 
workload, will create an incentive for owners and/or lisei^ to acquire state-of-the-art systems, thereby 
20 further increasing the potoitial processmg power of ^e distributed processing syst«n of the present 
invention. 

In addition, diiBFerent workload projects may be designated with different entry values, as 
weU. For example, some workload projects may require particular hardware or software processing 
25 systems within a client .system or device. Thus, the number of client systems that are capable of 
perfonnmg ttie task would be limited To fiirther encourage participation by those owners or users 
with c£?>able systems, flie entry value for taking on particular workloads and/or systems with the 
desired features may be aU(K:ated Mg^ 

30 Referring back to FIG. 4, control passes along'linb 426 to the '"process entries" block 412. In 

this block 412, the swe^stakes ^tries are processed 3nd,stored as desired. Following line 428, "end 
of entry period" decision block 414 represents a determination of whetiier the time for getting entries 
into the sweepstakes has ended. If not, the control continues to line 430 and bade to blocks 402, 404 
and/or 406, depending upon what is desired. Once the entry period has ended, control flows along 
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line 432 to "determine winners*' block 416. The server, system 104 then identifies from among the 
entries, vjbo the winning client system or systems will be. 

Jhe entry period may be any desired time frame and may include nuiMple overlapping time 
5 frames, as desired. For example, winners may be determined daily for entries each day, monthly for 
entries within a months and/or yeariy for entries within one year. In addition, special entry periods 
may be generated, if desired, for example where a particularly important workload project had a short 
time frame in ^liich it needed to be conpleted. 

10 FIGS. 1, 2A-C, 3A-D, and 4 are directed to example embodiments for a distributed 

processing system according to the present invention, including a sweq)stakes reward or incentive 
feature, as shown in the embodiments of FIG. 3A and FIG. 4. 

FIGS. 6A and 6B fiirther describe a capabilities scheduling feature, in vMch the server 
15 systems 104 may identify and consider any of a variety of cli^ system c£q>ability vectors in 
detennining how to organize, allocate and manage: woddoads and projects. FIGS. 5A and 5B 
describe a distributed processing system and workload project &at acconqplishes networic site 
indexing. FIGS. 7A and 7B describe a distributed processing system and a workload project that 

accomplishes network site testmg, such as quality of service (Qo^ testing and load testing. And 

.'•* 

20 FIG, 8 describes a distributed processing system, preferably with respect to a corporate intranet, that 
accomplishes distributed data back-iq). 

FIG. 9 is an alternative representation for the interconnection fabric for a distributed 

processing system environment and describes idle client system identification and shared component 

25 client systems. FIG. 10 describes a client system agent installed on a client system. FIGS. 1 1 A and 

IIB further describe machine genmted sweepstakes entries. FIGS. 12A and 12B describe client 

c^ability selection features. FIGS. 13A and 13B ^describe data conversion services. FIG. 14A 
....... . iX - • ■ 

describes a distributed processmg system that provides data transmission caching. FIG. 14B 

describes a distributed processing system that provides data sharing and file distribution fimctions. 

30 And FIG. 15 describes an alternative rgxresratation f0r a distributed processmg system, according to 

&e preset invention. ' 

> - 

Looking now to FIG. 5 A; block diagram is d^icted of a distributed processing system 550 
for a network site indexing application, according to flie {nresent invention. As stated above vtdfh 
35 respect to FIG. lA, the netwodc 102 may be a wide variety of networks. For tfns network site 



-21- 



wo 01/73545 



PCT/USOl/10060 



indexing application, the netwddc 102 may preferably be the Internet having a multitude of network 
sites 552 554. Each network site 552 ... 554 may have a variety of difT^ent content types that 
may be indexed, ranging fiom complex sites to relatively simple sites. For example, network site 
552 includes text 570A, images 570B, audio streams 57tfC, video streams 570D, files 570E and other 
content 570F. Network site 554 is less complex and includes text 572A, images 572B, and other 
content 572C. Both network sites 552 and 554^. are connected to the network 102 through 
communication lines 558 and 556, respectively. 

As discussed above, the server systems 104 manage woikloads for the client systems 108, 
110 ... 112. The client systems 108, 110 ... 112 process these workloads and produce inHexirie 
results. The resulting index may be stored at a centrally managed site, such as c^tral index storage 
block 560, or may itself be distributed over the possibly mUlions of indexing clients 108, 1 10 ... 1 12, 
as shown by remote index storage blocks 562, 564 ... 566. If remote index stotage is utilized, a 
master database content index may be stored locally,! for example, in the central index storage block 
560. Tliis content index may then direct relevant searches to the distributed massively parallel engfaie 
for search queries. 

Referring now to FIG. 5B, a functional block diagram is shown for a network site indexing 
op^tion 500 according to the present invention. As described in FIG. 1 A with respect to otho: 
systems 106^ there may be any mimber of compute and processing systems connected to the netwmk 
102. Any one of these others systems 106 may publish information on the network 102 for access by 
any other system connected to the network 102. This information to be indexed may take a wide 
variety of forms, including, for exanq>le, text, images, audio streams, video streams, databases, 
spreadsheets, PDF files, Shockwave data, Hash data, plications, data files, chat streams, or any 
other information, data or data streams that may be accessible on a network site. The distributed 
processing system of the present' invention may have as a workload the task of mdexing this 
potentially massive amount of information. 

•J* 

For example, u^iiere the network 102 is the ^Ihti^et or a large intranet, a large amount of 
processing power and time is needed to create an acciu:ate, complete and. up-to-date index of the 
information. The lutemet uses an IP Ohxtemet Proto^)!) address protocol to direct trafiSc around the 
Internet The IP address is the address of a conqm^ attached to a TCP/IP (Transmission Control 
Protocol/Intemet Protocol) netwodc Every system oi| the network must have a unique IP address. IP 
addresses are typically written as four sets of numbers separated by pmods. The TCP/IP packet uses 
32 bits to contain the IP address, which is made up of a network and host address (NEUD and 
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HOSTID). The more bits used for network address, the fewer remain for hosts. Web pages within a 
particular web site with a unique address may be addressed through URLs (Uniform Resource 
Locator) associated with that web site. In short, there is a limited, but very large, number of possible 
IP addresses for uniquely identifiable Internet sites flbat may be accessed and analyzed to generate an 
5 index of Internet sites and web pa^ via URLs. 

The operation diagram of FIG. SB starts wifli the "clients receive indexing workloads'' block 
502. Ill this block, the system server 104 provide the clients systems 108, 110 ... 112 wifli a 
workload task to index a portion of the information accessible on the network 102. For example, 
10 with the Internet, each workload may be smgle IP address or groiqps of URLs or, in some cases, large 
data types contained on single sites or pages. Following line 514, the "clients interact with other 
systems'* block 504 represents the operation of the agent installed on the client systems 108, 110 ... 
112 to access the network sites, according to &e assigned woddoad, and index the information 

i 

accessible on that site. This indexing may include all types of information accessible on that site, 
15 including text, audio, image, video, eto. 

Next, followmg lines 516 and 518, tiie client syst«ns 108, 110 and 112 coinplete the 
workload tasks, get &e results ready for transmission, and sends fliose results back to the system 
server 104 in "clients coniqplete workload" block 506 and "indexing results sent to server system" 

20 block 508. Control passes along line 520 to "mdex conq)iled for use" block 510 ^ere flie server 
system formats and/or compiles the results for use. For example, the index results may be utilized 
for accurate, complete and i^to-klate search information for the network 102. As indicated with 
respect to FIG. 5 A, the resulting index may be stored ranotely or locally following line 522. Thus, 
element 524 rqnpesents remote storage of ttie index, and elemoit 526 rq>resents central storage of the 

25 index. It is noted that the mdex may also be stored with a mixture of centrd a^ 

desired. In addition, as indicated above, a directory or sunmiarymdex for the resdtmgi 
generated and stored centrally^ if desked It is furdiei^ rioted that fliesmmnary index inaybie stored m 
any ofber desired fiishion, for exarrq>le, it may be redistributed and stored on a nunober of cli^ 
systems. 

30 

'i ' ^ . 

FIG. 6A is a block diagram for a server system 104 according to the present invention, 
including a control system 304, a workload database 308, and a database of capability vectors 620. 
The workload database 308 includes a variety of sets of workload projects WLl , WL2 . . . WLN. For 
each workload project, there may be multiple woridqiad units. For example, workload project WLl 
35 includes workload units WLll, WL12 ... WLIN, as represented by elements 640, 642 ... 644, 
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respectively. Similarly, workload project WL2 includes woridoad units WL21, W122 ... WL2N, as 
represaited by elements 646, 648 ... 650, respectively woridoad project WLN includes workload 
units WLNl, WLN2 ... WLNN, as represented by elements 652, 654 . 656, respectively. 

5 It may be ejected tbat different woridoad projects WLl, WL2 ... WLN within the workload 

database 308 may require widely varying processing requirements. Thus, in order to better direct 
resources to workload projects, the servor system may access various system vectors when a client 
system signs up to provide processing time and other system or device capabilities to the server 
system. This capabiUty scheduling helps fadlitate project operation and completion. In this respect, 

10 the capability vector database 620 keeps track of any desired feature of client systems or devices in 
capability vectors CBVl, CBV2 ... CBVN. represented by elements 628, 630 632, respectively. 
These capabSxty vectors may then be utilized by ; the control system 304 through line 626 to 
capability balance workloads. \ 

15 This capability scheduling ^according to the present invention, therefore, allows for the 

efiScient management of the distributed processing system of die present invention. This c^ability 
scheduling and distribution will help maximize thrdughput, deliver timely responses for sensitive 
workloads, calculate redimdancy factors when necessary, and in general, help optimize the 
distributed processing computing system of flie preseit invention. The following TABLE 1 provides 

20 lists of capability vectors <x fectors that may be utilized. It is noted tiiat this list is an example list, 
and any number of vectors or factors may be identified and utOized, as desired. 



TABLE 1 - Example Client Capability Vectors or Factors 



1. BIOS Support: 


a. BIOS Type (brand) 


b. ACPI 


c. SI, S2, S3, and S4sleqxAvake states 


d Dl, D2 and D3 ACPI device states 


e. Remote Wake Up Via Modem . 


f. Remote Wake Up Via Network 


i g. CPU Clock control 




i. Docked/Undocked state control 


j. APM 1.2 support 


k. Hotkey siqjport 


1. Resume on Alarm, Modem Ring and 
.LAN 


m. Password Protected Resume firom 
Suspend 


n. ^ FuU-Qn power mode 


0. APM /Hardware Doze mode 


p. Stand-by mode 


q. Suspend to DRAM mode 


r. Video Logic Power Down 


s. HDD, FDD and FDC Power Down 
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t. Sound Chip Power Dowa 


u. Super I/O Chip Power Down 






2. GPU Support: 


a. CPU Type (brand) 


b. MMX instruction set 


c. SIMD instruction set 


d. WNI instruction set 


e. 3DNow instruction set 


f. Other processor dependent instruction 
set(s) 


g. Raw integer performance 


h. Raw FPU performance 


i. CPU LI data cadie size 


j. CPU LI instruction cache size 


k. CPU L2 cache size 


1. CPU speed (MHz/GHz...) 


m. System bus (MHz/GMz...) speed 
supported 


a Processor Serial Number 


0. CPUID 






3. Graphic Support 


a. Graphics type (brand) 


b. # of graphics engines 


c. Memory capacity 


d. OpenGL support 


e. DirectSD/DirectX support 


f. Color depth siqjported 


g. MPEG 1/n decode assist 


h. MPEGl/n encode assist 


i. OS support 


j. Rendering type(s) supported 


k. Single-Pass Multitexturing siq>port 


1. True Color Rendering 


m. Triangle Setup Engine 


n. Texture Cache 


i 0. Bilinear/Trilinear Filtering 


p. Anti-aliasing support 


q. Texture Compositing 


r. Texture Decompression 


s. Perspectively Correct Texture 
Moping 


t, Mip-Mapping 


u» Z-bu£fering and Double-buffering 
^ support 


V. Bump mapping 


w. Fog effects 


X. Texture lightmg 


y. Video texture support 


z. Reflection siQ>port 


aa. Shadows support 






4. Storage Support 


a. Storage Type (brand) 


b. Storage Type (fixed» removable, etc.) 


c. Total storage capacity 


d. Free space 


e. Througfhput speed 
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FIG. 6B is a fimctional block diagram for capabilities detennination and scheduling 
operation 600 for workloads in a distributed processing system according to the present inventioiL 
Initially, various vectors are identified for which capability information is desired in the "identify 
client system c^ability vectors" block 602. Following line 612, the server systems 104 then 
5 capability balances workloads among client systems 108, 110 and 112 based n^on the capability 
vectors in the "capability sdieduling workloads based on vectors** block 604. Then flie cq>abilities 
scheduled workloads axe sent to the client systems for processing in the "send capability scheduled 
workloads" block 606. 

10 This capability sdiediding and management based upon system related vectors allows for. 

efBdent use of resources. For exaiiq>le, utilizing the operating system or software vectors, 
woridoads may be scheduled or manage so that desired hardware and software configurations are 
utilized. This scheduling based upon software vectors may be helpfid because different software 
versions often have different csq)abilities. For example, various additional features and services are 

15 included in MIC310SOFT WINDOWS '98 as compared with MICROSOFT WINDOWS '95. Any 
one of these additional fimctions or services may be desired for a particular workload that is to be 
hosted on a particular client system device. Software and operating system vectors also allow for 
customers to select a wide variety of software configurations on vAdch the customers may desire a 
particular workload to be run. These varied software configurations may be helpfiil, for example, 

20 vfdiere software testing is desired Thus, the distributed processing system of the present invention 
may be utilized to test new software, data files,' Java programs or other software on a wide variety of 
hardware platforms, software platforms and software versions. For exanq)le, a Java program may be 
tested on a wide proliferation of JREs (Java Runtime Engines) associated with a wide variety of 
operating systems and machine types, such as p^isonal computers, handheld devices, etc. 

25 • 

From the custcnner systCTi perspective, the csq>ability manag^nent and the c£q)ability 
database, as well as infonnafion concerning users of the distributed devices, provide a vehicle 
throtig^ \i^ch a customer may select {Articular hardware, software, user or other configurations, in 
which the customer is interested Jn other words, utilizing flie massively parallel distributed 
30 processing system of ftie present invention, a wide vmety of selectable distributed device attributes, 
including information concmnng users of the distributed devices, may be provided to a customer 
with respect to any project, advertising, or other information or activity a customer may have to be 
processed or distributed. 
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f. Seek time 


g. User dedicated space for current 
workload 


h. SMART capable 








5. SystCT 


a. System Type (brand) 


b. System fonn factor (desktop, portable, 
workstation, sorer, etc.) 








6. Communications Support 


a. Type ofConnection (brand of ISP) 


b. Type of Connection Device (brand of 
hardware) 


c. Hardware device capabilities 


d. Speed of connection 


e. Latency of connection 


f. Round trip packet time of connection 


g. Number ofhops on connection type 


II Automatic connection si^ort (yes/no) 


L Dial-up only (yes/no) 


j. Broadband type (brand) 


k. Broadband connection type 
(DSL/SatyCable^l/Intranet/etc.) 






7. MCTiory 


a. Type of memory error correction 
(none, ECC, etc.) 


b. Type ofmemorysi5)ported (EDO, 
SDRAM, RDRAM, etc.) 


c. Amount of total memory 


d. Amount of fiee memory 


e. Current virtual memory size 


£ Total available virtual memory size 


■. ■• 






8. Operating Syston 


a. Type of operating system (brand) 


b. Version of operating system 


c. Health of operating system 






9. System ajjpiication software 


a. Type of software loaded and/or 
operating on system 


b. Version of software 


c. Software features enabled/disabled 


d. Health of software operation 
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For example, a customer may desire to advertise certain goods or services to distributed 
devices that have certain attributes, such as particular device capabilities or particular characteristics 
for users of those distributed devices. Based upon selected attributes, a set of distributed devices may 
be identified for receipt of advertising messages. These messages may be displayed to a user of the 
5 distributed device through a browser, the client ag^t, or any other softw^ that is executing either 
directly or remotely on the distributed device. Thus, a customer may target particular machine 
specific device or user attributes far particular advertismg messages. For exanq>le, users vdfh 
particular demogr^hic information may be targeted for particular advisements. As another 
exaniple, the client agent running on client systems that are personal conq)uters may detennine 
10 systems tiiat are suffering firom numerous page &ults (i.e., dm>ug|i tracking operating system heal& 
features such as the number of page &u]ts). Hig|i numbers of page fiults are an indication of low 
memory. Thus, memory manu&cturers could target such systons for memory iq)grade banners or 
advertisements. 

IS Still finrther, if a customer desires to run a woiidoad on specific device types» specific 

hardware platforms, specific operating systems, etc., &e customer may then select these features and 
thereby select a subset of the distributed client systems on vMch to send a project workload. Such a 
project would be, for example, if a customer wanted to run a first set of simulations on personal 
conqmters Avitb AMD ATEILON microprocessors dnd a second set of simulations on personal 

20 conqniters with INTEL PENTIUM HI microprocessors. Alternatively, if a customer is not interested 
in particular configurations for the project, the customer may simply request any random number of 
distributed devices to process its project workloads. 

Customer pricing levels for distributed processing may then be tied, if desired, to the level of 
25 specificity desired by a particular customer. For exanQ>le, a customer may contract for a block of 
10,000 random distributed devices for a base amount The customer may later decide for an 
additional or different price to utilize one or more capability vectors in selecting a number of devices 
for processing its fnrdject Furttier, a customer may request that a numb^ of distributed dbvices be 
dedicated solely to processing its project- workloads, in short, once device attributes, including 
30 device capabilities and user information, are identiped, according to the present invention, any 
• number of customer offerings may be made based •iq)on the device attributes for the coimected 
distributed devices. It is noted that to facilitate use of the device capabilities and user information, 
capability vectors and user infonnation may be stored and organized in a database, as discussed 
above. 

35 
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Referring now to FIG. 12A, a block diagram depicts a distributed processing system 1200 
that allows customens to select client system attributes, such as device capabilities and user 
characteristics, according to the present invention. In this embodicnent, the network 102 is depicted 
as the Internet to vMch server systems 104, customer 152A, customer 152B, and client systems 
5 1202A, 1202B ... 1202C are connected. These systc^ axe connected ihrougib communication links 
114, 119A, 119B, 1204A, 1204B ... 1204C, respectively. As noted above, these communication 
links may include any of a wide variety of devices and/or communication techniques for allowing a 
system to interface with other connected systems. 

10 As shown in FIG. 12A, and as discussed above, the customers 1S2A and 152B may desire to 

send information or projects, such as advertisements (ADV) 1206A and 1206B and/or projects 
(PROJ) 1208A and 1208B, to groups of client systems that have particular or selected capabilities. 
The numb^ of different groiq)s of client systems is as varied as the cq>ability and user data available 
for those client systems. The client systems 12Q2A represent client systems lliat include a first set 

15 (Set 1) of desired attriimtes. The client systems 1202B rg>resent client systems tiiat include a second 
set (Set 2) of desired attributes. And the client systenus 1202C represent client systems that include a 
Nth set (Set N) of desired attributes. Once attributes are selected, the client systems with those 
attributes may be accessed as desired by customers 152A and 152B. For exanople, customer IS2A 
may send its advertisement to client systems 1202B. Customer 152B may send its advertisement to 

20 client systems 1202A. The project 1208A firom customer 1S2A may be processed by client systems 
1202C. And die pn)jectl208Bfix>m customer 152B may be processed by climt systems 1202B. It is 
noted, ttierefore, that any combination of desired attributes, such as device capabilities and user 
characteristics, may be identified and utilized to satisfy customs objectives, whetiiier those objectives 
be advertising, project processing, or some other desiribd objective. 

"25 ' ! 

FIG. 12B is a block flow diagram fiir client system attribute selection, according to the 
present invention. In thp embodiment shown, pro(^ 1250 begms with the customer selecting 
desired attributes in block 1252. Next, client syst^ mth selected attributes are kci^ed in block 
1254. And, then in block 1256, the custcnner objectiye, sudi as advertising or project, is processed 

30 by the client system. Control of this process 1250 liiiay be provided by flie s^er systems 104, if 
desired, such that the customer interfaces with the server systems 104 to select device attributes and 
then the servers systems 104 access the client systems. Alternatively, the server systems 104 may 
sbaaply provide the customer with a list of contact information (e.g., IP addresses) for fbo client 
systems, so that the customer may directly access the client system, for example, in providing 

35 advertisements to the users of the client systons. It is further noted that other control techniques may 
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also be used to identify and access client systems with particular desired device c^abilities^ user 
characteristics, or other device attributes, according to the client system attribute selection method of 
the present invention. 



.5 FIG. 7A is a block diagram for a distributed processing system 100 according to the preset 

invention, including example network sites 106A and 106B on which site testing is to be conducted, 
such as load testing and/or quality-of-service (QoS) testing. FIG. 7A is similar to FIG. 1 A except 
that other systems 106 in FIG. lA has been rqnesented in tibie embodiment of FIG. 7A with network 
sites 106A and 106B. Communication line 116A between the network 102 and flie network site 

10 106A represents a interaction by one cli^ system 108; 110 and 112. Communication lines 116B, 
116C and 116D represent interactions by more than one client system 108, 110 and 112. 

Site testing is typically desired to detetmine how a site or connected s^ce performs under 
any desired set of test circumstances. Wi& tiie distributed processing system of the present 

15 invention, site performance testing may be conducted using any number of real client syst^ns 108, 
110 and 112, rather than simulated activity that is currently available. Several tests that are 
commonly desired are site load tests and quality of service (QoS) tests. Quality of service (QoS) 
testing refers to testing d us^'s experience accessing k netwoik site under normal usability sttuaticms. 
Load testing refers to testing ^diat a particular netwodc site's infrastructure can handle in user 

20 interactions. An extreme version of load testing is a denial-of-service attack, where a system or 
group of systems intention^ly attetapt to overload and shut-down a netwoik site. Advantageously, 
the current invention will have actual systems testiiig network web sites, as o[^osed to simulated 
tests for which others in the industry are capable. 

25 Network site 106B and the multiple interactions represented by communication lines 116B, 

116C and 116D are intended to represent a load tesimg environment. Network site 106A and die 
single interaction 116A is indcative of a usj^ interaction or QoS test^^ ItisiK>tedtfiat 
load testing, QoS testiing arid any other site testing maiy be conducted witti any number of interactions 
from client systems desired, and the timing of those interactions may be manipulated and ccmtrolled 

30 to achieve any desired testing parameters. It is for&er noted that periodically new load and 
breakdown statistics will be provided for capacity planning. 

FIG. 7B is a fimcticnial block diagram for i a site-testing operation 700 according to the 
present mventioiL Initially, client systems 108, 110 and 112 receive workloads that identify testing 
35 procedures and parameters in flie "clients receive tes^ng workload*' block 702. Following line 714, 

'i 
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the clirat systems 108, 110 and 112 access the site being tested and perform the testing in block 
"clients interact 'with other systems'* block 704. Next, following lines 716 and 718, the client 
syst^ns 108, 110 and 112 complete the site testing woikload tasks^ gjst the results ready for 
transmission, and send those results back to die system server 104 in "clients complete testing 
workload^* block 706 and "site testing results sent to server system" block 708. Control passes along 
line 720 to "site testing results compiled for use" block 710 where the server system format^ and/or 
compiles the results for use by the netwoiic site. For exanqple, the site testing results may be utilized 
determining modifications that need to be made to thd network site to handle peak volimie activities. 

FIG. 8 is a block diagram for a distributed processing system 800 for a data back-up system 
application, according to the present invention. As stated above with respect to FIG. 1 A, the network 
102 may be a wide variety of networks, including an intranet network. Intranet networks, such as 
internal networks set up by corporations, are particularly suited for this application because flie 
systems holding the data bdng backed-iq> woiild be owned by the same entity owning other systems 
with excess data stomge capabilities. In fiiis way, security would not be as great of an issue and the 
client system types could be better controlled It is noted, however, that this data badc-up application 
would be equally s^plicable to other netwoiks, such las for computer systems connected through the 
Internet 

Referring back to FIG. 8, client systems 108^ 110 ... 112 are shown each having a back-up 
data blocks 804, 806 . . . 808. Customer systems 152 is shown as having data 802, uriuch is desired to 
be backed-iq> with the distributed back-iq[> systooi 800. The server systems 104 manage the flow of 
data &om the data 802 and the client systems that have extra storage space repres^ted by back-iq) 
data blocks 804, 806 ... 808. In operation, the server systems 104 identifies client system storage 
cq>abilities. With this information, die server systeiins 104 can receive data for back-up 6om any 
system on the network 102. It is noted, and as indicated with respect to FIG. lA, the client systems 
108, 110 ... 112 and the customer systemis 152may commumcate directly with each othdr i^ 
pedrl^ communications. I 

3 ■ ■ 

The server systems ld4may also inaxmgeflie storage and traiisfer of data so that the data : 
be readily retrievable once backed-iq;> and stored on fiie blient systems 108, 110 ... 112. If desired, 
an summary index or directory of the backed-iq) data may be stored centrally on the server systems 
104. or may be stored remotely on die cli^t sjfstems 108^ 1 10 ... 112. It is also noted tbat the scxvet 
systems 104 may also distribute data badc-iq> workloads so that each portion of the data 802 is stored 
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redundantly on at least two of the climt systems 108, UO ... 112. This redundancy provides added 
security should any one or more client systems suddenly cease to be operational. 

Looking now to FIG. 9, a block diagram is .depicted of an alternative representation of an 
5 interconnection fabric for a distributed processing system environment 100, according to the present 
inventioiL In this diagram and as described above, the netwodc environment may be ft© Internet, an 
internal company intranet, a local area network (LAN), a wide area network (WAN), a wireless 
network, a home network, or any other system that connects together multiple systems and devices. 
In addition, flie server systems and clients systems may be interconnected by a variety of possible 

10 coxmection interfaces, for example, Ethernet connectioiis, wireless coimections, ISDN connections, 
DSL connections, modem dial-iq> connections, cable modem connections, direct Tl or T3 
connections, fiber optic connections, routers, portal con^^ters, as well as any other network or 
communication coxmection. It is noted, tha:efore, as discussed wifli respect to other embodiments 
such as the embodiment of FIG. lA, that systems may be coiq>led into an interconnected &bric in any 

15 of a variety of ways and conmmnications can potentially occur direcdy or indirectly between any of 
the systems coupled into flie fabric, as would be understood by those of skill in the art 

Within this environment, as depicted in FIG 9, server systems 104 are interconnected with 
any number of client S355tems, for exan^le, client systems 108A, 108B, 108C, 108D, 108E, 108F, 

20 108G, 108H, 1081, 108J, 108K and 108L. In addition, these cUent systems may also inchide idle 
client systems 902A, 902 B, and 902C, as discussed further below. Furthermore, fliese cliait systems 
may include client system 904A with a component A, client system 904B wifli a component B, and 
client system 904C with a cotnpoasnt C. It is also ndted that tiie interconnection fabric may include 
any number of devices that are not client systems, in that they themselves are not providing 

25 conqionents or processing capabilities for the distributed processing system of the present inventioa 
Nevertheless, these devices may be considored part 6f tl^ system because fliey may relay, interpret, 
process or o&ierwise transmit or receive infoxmatiori,fr6m or to client systems tiiat are part of fhe 
distributed pn)cessingsysteriL ? ^ 

30 Aggregation of component level resources, according to the present raventirti, will now be discussed. 
As described above, the c^abihties of client systems are determiiied for purposes of allocating, 
scheduling and managing distributed processing workloads. In other words, each of fee client 
systems may be made up of inany individual siibsysten^ In some cases, it 

may occur that particular conq>onents on dififerent madbmes nmy provide added value if combined or 

35 aggregated Thus, utilizing subsystem or component Wei resources fi^ 
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devices may be the most efiBcient or oflierwise advantageous of taking advantage of these 
resources to complete various desired tasks. 

Referring now more particularly to FIG. 9» the client S3^tiems 904A, 904B and 904C may 
5 have component A, CQmponent B and componeiit C, respectively, that are better utilized in 
combination. For exanq)le, clioit system 904A may have a fast processor, a high-speed network 
connection, but little available storage space. Client system 904B may have large amounts of 
available fiee storage space but little processing power. Ghent system 904C may also have a &st 
processor, but relatively Utde available storage spacer In this example, a workload that requires bofli 

10 a large storage capacity and a fast processor may be 'efBcienlly ccnnpleted by dedicating CQnq)onent 
level rissources to various parts of the woridoad fixxm different machines. Thus, the workload may be 
managed by having cUent systems 904A and 904C processing data stared on and transmitted from 
ctient system 904B. Once clients systems 9(MA and 9MC prociess data, this resulting data niay 
be transmitted back to client system 904B for aggregation and evoxtual transmission back to the 

IS serv^ systems 104. The client system 904B, therefore, essentially acts as a s^er for a workload 
subset, sending out portions of a subset woridoad, receiving back the processed data, and aggregating 
the data to build a completed workload subset 

It is noted that any number of different conqxments 6om different client systems may be ' 
20 aggregated, as desired. For exaixq>le, for wireless devices, DSP processing and storage component 
could be aggregated with conoponents fiom other elicit syst^ns. For display devices, graphics 
rendering power could be aggregated For relativelj^ dumb machines, such as cormected household 
s^liances, vending machines, etc., slow-speed processing components could be aggregated. In 
short, an appropriate workload may include instructions to numerous client systems that will enable 
25 collaboration and aggregation of component leyel resources. Such instructions may include things, 
such as, where to receive iiq)ut, vfb&ro to send outpnit, and ultimately y^Adch client systems return 
final results. ' 

It is further noted that the control instructionS:=:niay be de-centralized as wiell. In other words, 
30 as indicated above, chent systems may communicate directly with each other, for exanq>le, in a peer- 
to-peer fashion. In this way, woikload communicatiQns may occur directly between client systems, 
and workload control and management may occur Arough the client system agents located on client 
systems. 
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Still referring to FIG. 9, idle system determination will now be discussed. As stated above, 
client system capabilities are determined and utilized within the distributed processing system of the 
present invention. The more idle any particular client system, the more processing it is arguably able 
to accomplish, and the more incentives it is likely to receive. In other words, flie client system 
capabilities may be utilized more often and more intensely if the client system is more idle. As such, 
it is advantageous to identify idle client systems and allocate them to more processor and time 
sensitive tasks. By identifying these idle client systems, resources available on the network at any 
given time may be more fully utilized, and otiierwise idle resources may be utihzed for highly 
intensive, real-time activities that would otherwise require dedicated devices. Examples of such real- 
time activities include data caching, indexing, etc. In FIG. 9, idle cUent systems arc designated as 
902A,902B and 9020. 



Identifying idle resources may be determined ia any of a variety of ways. Itcis possible, for 
example, to simply look at wheflier a machine is not being used or has low processor utilization at 

15 any given time. This simple determination, however, iriay not yield an accurate picture of how idle a 
client system may or may not be over a given time period. More particularly, discovery mettiods 
may be implemented to identify the activity of ai variety of client system componaits and 
subsystems. For example, subsystems may be monitored, such as network activi^, device output 
activity, user input, processing activity, executing task monitoring, or mode of operation parameters 

20 (e.g., mobile or power management modes, stationary or powered mode). In addition, any number 
of other device vectors may be monitored or analyze&to detmnine the true usage and idleness of a 
client system. 

The following TABLE 2 provides a list of idleness vectors or factors that may be utilized in 
25 determining the level of device usage or idleness. Ifa particular, TABLE 2 provides two primary 
categories of activities to monitor or analyie for determination of how idle a cUent system may or 
may not be. These activities are user activity and device activity. By monitoring, analyzing and 
tracking these client system elements and activities over time, a better determination of device usajge 
and idleness may be made. It is noted that the list provided in TABLE 2 is an example list, and any 
30 numbCT of categories, vectors or factors may be identified and utilized, as desired, according to the 
present invention. 
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TABLE 2 - Example Client I^eness Vectors or Factors 



1. User Activity (e,g., monitor input 
activities, monitor output activities, 
monitor time closed since last input event 
and between iiq>ut events, etc.) 


a. keyboard input 

■ 


b. mouse iiq>ut . 


c. microphone/voice input 


d. tablet input 


e. peniiq}Ut 


f. touch screen iiq)ut 


g. joystick ixq)ut 


h. gamepad ix^ut 


i. video output 


j. printer output 


k any other user activity tiiat could be 
utilized to classify if a device is idle 


2. Device Activity (e.g., monitor utilization 
levels, monitor time el^ed since last 
device activity, monitor time between 
changes in device utilization levels, etc.) 


a. powei: state (e.g., time since last power 
state change event) 


b. mobility state (e.g., time since device 
last in mobile state) 


c. screm saver activity or trigger (e.g., 
time el^ed since Screensaver activity 
or trigger) 


d. screen output (e.g., time elapsed since 
last screen output, paint eyent or pixel 
change) 


e. network or communication packets 
sent or received (e.g., time elapsed 
since last network or communications 
activity) 


£ storage device activity (e-g., time 
elapsed smce last storage device 
activity, such as hard drives, fla^ 
memory cards, removable drives, CD 
drives, DVD drives, etc.) 


g. processor, DSP, microcontroller^ 
embedded device, or other processor 
activity (e.g., time elapsed since last 
processor activity) 


h. processor, DSP, micrbcdntroller, 
embedded device, or other processing 
device utilization (e.g., change in 
utilization levels) ' 


i. tasks or processes executing (e.g., time 
elapsed since change in number of 
tasks <ff processes executing) 


j. task or jsrocess device utilizaticm (e.g., 
time since change in task or process 
device utilization) 


k. any odier device activity that could be 
used to classify if a device is idle 
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As a further exmnple of the usefidness of tiiis determination, reference is made back to FIG. 
9. Server systems 104 may have, for exaznple, a large, intensive task that it would hke to place on 
these idle devices. After using a number of the vectors in TABLE 2 to detennine the utilization level 
for cUent systems, the server systems 104 detennines that client systems 902A, 902B and 902C are 
5 idle and capable of handling significant time sensitive processing tasks. For example, idle client 
syst^ns 902A, 902B and 902C may be personal computears tiiat can act as a local internet cache for 
other connected devices, such as some of the other client systems depicted in FIG. 9, that are 
interested in a data type that benefits firom a local netwotk cache. Thus, data or content may be 
transmitted firom a remote network site to the idle machines 9Q2A, 902B and 9Q2C. These idle 
10 devices 9Q2A, 902B and 9Q2C may then re-transmit this same data or content to o&er connected 
devices also interested in the data or content 

One example for such network cachmg is Internet video or multimedia broadcast events that 
are desired to be viewed or received by a very large number of geographically close cormected 

15 devices at about the same time. In order to meet the demand of these connected devices, web sites 
broadcasting an event have to be able to handle a huge mcrease in network trafBc over a short period 
of time. By locally caching the transmission to idle client systems, a web site can reduce flie direct 
demand on its own resources. This is so because other connected devices may receive a re- 
transmitted broadcast, although delayed, firom the idle client system. It is noted that according to the 

20 present invention idle client systems 902A, 902B and 902C may work independently or in 
combination. Even ttiough idle client systems are suited for providing the caching fimction, it is also 
noted that that network caching may be accomplished using one or more client systems regardless of 
their respective levels of idleness. 

25 FIG. 10 is a more detailed block diagram for a client syst^ agent 270 installed on a client 

system, according to the present inventiorL This diagram includes a security subsystem 1010, a 
cjq>abilities subsystem 1006, a woridoad processor 1004, a user inter&ce 1002, and a project 
management and agent control ^bsystem 1008. The various coix^dniebts and subsysteths may 
comnaimicate wifli each othw, for example, through lines 1012, 1014, 1016, 1018 and 1020. 

30 Extmially, the client system agent 270 may communicate through its security subsystem 1010 with 
the odier compon^ within flie client system and ultimately to other devices connected into die 
network &bric. It is noted that configuration of the client system agent and its operation, both 
internal and external, may be selected and designed, as'deisned. 
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As depicted, the capabilities subsystem 1006 . includes an idle system monitor 1022, as 
described above, that monitors and analyzes user and device activities associated with the client 
system to detennine the level of activity or idleness for the client system. The information 
determined by this idle system monitor 1022 may &en be communicated externally, for example, 
5 through tiie security subsystem 1010 to the server syst^ns 104. The s^er systems 104 may tiien 
store and analyze system idleness data fiom across the distributed processing system. This idleness 
data may become part of the c^abilities database that is utilized to allocate and manage workloads 
and processing system resources. 

10 Still referring to. FIG. 10, the workload processor 1004 includes a machine entry generation 

subsystem 1024. As described above, the workload processor 1004 may send completed workloads 
back to server systems 104 to genmte sweepstakes entries for the host client system. In this way, 
when the incentive is a sweepstakes, the client ^sy^em may generate entries by conq>leting 
workloads. The machine entry g^eration subsysteih 1024 refers to this entry generation tiirough 

15 workload completion. As discussed above, the worldoad processed to generate entries may be a . 
project woddoad, an entry workload, or any otber wo^oad, as desired. 

FIGS. UA and 1 IB provide more detailed flow diagrams of process embodiments for 
machine generated sweepstakes entries through processing of entry workloads, according to the 
20 present invention. 

Looking first to FIG- 11 A, an entry worldoad process flow 1100 is depicted that provides 
machine generated sweepstakes entries. Process moves fiom start block 1 102 to block 1 104 in which 
entry workloads are loaded on clirat systems. Next, process flows to block 1106 which rqiresents a 

25 periodic timer or other timing control for entry worldoad processing. After this timing control, the 
clientsystem executes orprocesses the entry woridoad in block 1108. Inblock 1110, asweq>stakes 
entry is thereby generated and returned to flie server^ sy^^ 104 based upoa the completion of this 
e^itiy worldoad. Fr6cess contrdl then may pibceed back to tiie periodic timing block 1106, wbsio 
timmg control determines when the entry workload^ is inext processed. The completed worldoad 

30 rqxresents the machine generated sweepstakes entry. 

FIG. IIB is an altraiative entry workload process flow 1150. The process flow 1150 is 
similar to the process flpw 1100 excq>t that the entry workload is set^t to the client system each time 
it is to be run. Process starts in block 1 102 and passes to the periodic timer block 1 106, in ^^^ch the 
35 process is controlled. For exan^le, server systems 104 may detennine when it is deskable for the 
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client systems to receive and process an entry workldad. In block 1104, the entry workload is sent to 
the client systems. As with FIG. IIA, the elicit systems then execute the entry workload in block 
1108, and an entry is generated and returned to the iemote server systems 104 in block 1110. The 
process then proceeds back to the periodic tim^ 1106 until it is determined that another entry 
5 workload should be processed. The primary differoice between process 1150 and process 1100 is 
diat process 1150 is depicting an entry workload that is transmitted to the client system each time it is 
toberun. 

One exainple utilizing the process 1150 or :the process 1100 is for server systems 104 to 
10 query the client systmis for entry wotUoad processing at regular time intervals. If a distributed 
device returns a completed entry workload back within a selected period of time from the distribution 
of the entry workload, the server system may conclude that the distributed device should receive an 
entry because the distributed device is providing resources to the distributed processing system. In 
this way, the server systems 104 may determine at regular intervals \^ether a given client syst^ is 
15 working on project woridoads for the distributed processing system. Alt<matively, the client system 
agent may locally control the worldoad processmg and may, for exanqple, cause the client system to 
process and generate entries at regular time intervals. It is noted that nonnregular and varying time 
intervals may also be utilized and that combinations of remote and local control may also be utilized, 
as desired. 

20 

The timing of when a client system proqesses the entry workload, therefore, may be 
determined locally by tiie client system agent or reniotely, for example, tiirougih conmiands sent by 
the server systems 104. In addition, periodic timing control may also be accon^lished tiirough 
various combinations of control routines residing locally and remotely. It is further noted that any 
25 nunoberofdifferent variations rimy be utilized to provide mach^ 

according to the present invention. Thus,aclientsy^CTimaygenrate sweepstakes entries in any of 
a variety of ways and still have madiine generatec| sweepstakes oitries, according to the present 
inveibition. i ^ 

30 FIGS. 13A and 13B describe a data ccHXversion plication 1300 for a massively parallel 

distributed network according the present inventioiL In particular, FIG. 13A is a block diagram of a 
distributed processing system that provides data conversion services, according to the present 
invention. And FIG. 13B is a block flow diagram for data conversion services within a distributed 
processing system, according to the pres^ invention^. 

35 
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Converting file types, web pages, graphics imagps, etc., between device types can be a highly 
int^ive processing task. Exan^le devices that oft^ need converted data are wireless devices, such 
as pagers and cell phones, that request Internet web page information firom their respective device 
servers. The device server, instead of incurring the overhead of leformattmg the requested data for 
5 the wireless devices, may instead distribute die requested page or data address, flie device type 
information of the requesting device, and return address for die reformatted data. According to the 
present invention, the data conversion, translation or processing may be p^ormed by a client system 
of the distributed processing system of the present invention. The resulting data may then be 
returned or provided to tiie original requesting device. In addition to data formatting for cell phones, 
10 language conversion, text translation and media translation services, or ai^ other desired data 
conversion can also be hosted for a customer through the distributed processing syst^ of the present 
invention. 

It is noted that tiie data conversion (q)mtion contemplated by the present invention is not 
I S limited to any particular requesting device, any particular service provider, any particular type of data 
to be processed, any particular type of resultmg processed data, or any jparticular data source. Thus,- 
the data processed may include voice, t^, applicaticm, image, source code, or any other data type or 
combination of data types, and the resulting processed data may also include voice, text, application, 
image, or any other data typo or combination of data tyjpes. According to the present invention, the 
20 distributed processing system is utilized to process ai^ data that is desired by a requestmg device and 
that must be converted or processed before bdng prpvicled to the requesting device. For example, 
end-user devices connected to the Internet, such as personal con^uters, may sign up for data 
conv^ion services through the server system soj that the end-user device may request data 
conversion of any desired data, file, wd> site content, etc. Language translations and data formatting 
25 for connected wireless are just two examples of such plications for tiie present invention. 

Ix>oking now to the embodiment of HG. 13A, the netwoik 10^ 
and the requesting devi^^ oiie or more i^less devices 1306 comedted to the Internet 102 through 
communication links 1308 and to the wireless dsvick server systems 1304 througih communication 

30 link 1309. The data to be converted, translated or of^terwise processed is represented by block 1302 

Si 

and may be, for example, content fiom an Internet web site that is connected to the hitemet through 
communication link 1312. Also, as shown in FIG.i l3A, a massively parallel distributed network 
(MPDN) server 104 is connected to the Internet 102 thrqu^ communication link 114. The wireless 
device server systems 1304, or any other connected system that desires to off-load data conversion 
35 processing requiremmts (e.g., web site content servers), are connected to the Internet 102 through 
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communicatiQn links 1310 and to the MPDN server 104 tbrou^ communication links 1311. Any 
number of client systems 108, 110 ... 112 may also be connected to the Internet 102, through 
communications links 118, 120 ... 122, respectively. As also stated above, any of the connected 
devices may communicate witii each other in any of a mde variety of conununication tediniques 
5 (e.g., wireless, electrical, digital, analog, light-based; etc.) and protocols (e.g., static or (fynamic IP 

addresses), and through any number of other device^ as would be understood by one of skiU in the 

J. 

art 

In the application contenq)lated by FIG. 13A, the wirdess devices 1306 at times request data, 
10 for ^cample, images or te3ct from a web site, that niust be converted, translated or otherwise 
processed by wireless device s^ersystons 1304 before it can be transmitted to, and di^layed on, a 
requesting wireless device. Instead of converting; the information, the wireless device servers 
systems 1304 may request that the MPDN server 104 accomplish the data conversion or translation. 
The device server systems 1304 may then provide to the MPDN server 104 any pertinent 
15 information, sudi as information concerning the reqi(esting device, the nature of &e data requested, 
and the processing needed fOT the data. The MPDN Server 104 may tiien utilize one or mote of the 
client systems 108, 110 ... 112 to process the data frcmi block 1302 for transmission to the requesting 
device. In this way, the wireless device server systems 1304 nciay off-load burdensome and process- 
intensive conversion tasks to the distributed processing system of the present invration. 

20 

It is noted the transmission of processed data to the requesting wireless device 1306 may 
occur in a variety of ways. For example, the processed data may be transmitted from a client s;^tem 
108 to the server 104, then to the wireless device server 1304 and finally to the wireless devices 
1306. Altematively, the processed data may be transmitted from a client system to the wireless 
25 device server 1304, and then to the wireless devices 1306. Still further, the processed data may be 
transmitted directiy from a client system to the wireless devices. 

FIG. 13B provides a basic flow diagram fo^; aii embodiment of a data conversion process 
1350 according to the present invention. Li block 1352, a device, such as wireless devices 1306, 

30 requests unconverted, non-translated or non-processed dkta. In block 1354, a server for the device, 
such as wireless device server systems 1304, processes the data request and contacts the MPDN 
server 104. In addition, the content iMX)vider or serirer for the requested data, such as a web site 
content server, may contact the MPDN server 104. The wireless device server systems 1304 provide 
all pertinent information to the MPDN server 104, such as the type of calling device, its 

35 identification, the relevant data requested, and the conversion to take place. The MPDN server 104 
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tfaea distributes the data and infonnation concmiing the requesting device to one or more client 
systems, such as client systems 108, 110 ... 112, in block 1356. The one or more client systems then 
convert, translate or otherwise process the data in blobk 1358. The converted, translated or processed 
data is then provided to the requesting device in block 1360. Again, in this way, the device servers 
5 may provide a wide range of infonnation without having to provide itself die processing power to 
accomplish the conversion, translation or processing that is required to transmit or di^lay the data on 
a requesting device. 

As shown in HG. 13B, the device server or the content server 1304 may communicate data 
10 and odier pertinent infbrmatioh for a conversion directly to the cUent systems. For exaniple, the 
MPDN server 104 may provide access to a group of client systems for data conversion purposes for 
given periods time (e.g., monthly client group allocations), or may provide identities of groups of 

client systems that may be used at &e time a converdoii is needed. Once the identity and allocation 

i 

of client systems to a p^cular device server or content;server is made, the device server or content 
15 server may communicate directly with the client systems, hi addition, Hbe device server or content 
server may provide directly to a requesting device the id^itity of the one or more client systems 
acconq)lisbing the data conversioxL As shown in FIG. 13B, the requesting device, fh^fore^ may 
commxmicate direcdy with the client system or syst^ois to provide pertinent information concerning 
the data conversion requested. The client system may then, for example, directly download the 
20 desired content and perform &e desured data conversion It is fiirtfa^ noted fliat in addition to the 
embodiments desoibed above with respect to FIGS. 13A and 13B, other methods for requesting, 
processing and providing data to and from the ^questing device may be implemented with 
- distributed processing system of the preset invention, such as caching processed data for later 
transmission. 

J- 

25 

FIGS. 14A and 14B depict example block diagrams of fUe distribution and data sharing 
through the network fabric, according to the presentlinVention. In particular, FIG^ 14A depicts an 
^tenuit datta file distxibutioh syst^ 1400 that relies ixpm client systems to jttovide local data 
distribution. FIG. 14B depicts a data jGle distcilnition system 1450 that allows for data sharing and 
30 rapid transmission of a project or data files through the distributed processing systenou 

Looking now to FIG. 14A, a block diagram is depicted of a distributed processing system 
1400 that provides data transmission caching or other local distribution, according to the present 
invention. In the embodiment of FIG. 14A, $enrer systems 104 are connected through 
35 conmiunication link 114 to the Internet baddxme 1402. The Internet backbone 1402 represents the 
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veiy high speed cotmectioos tiiat cany data long distances, for example, T3 or fiber optic lines that 
cany Internet data across the United States. A web site 1404 is connected to the Internet backbone 
1402 through communication link 1406, which represents a geographically local connection. Hie 
connection block 1410 represents a geogrq)faicaIIy remote communications link, such as a POP 
S server, head-end machine, telephone line central office, cell site, etc. This communications block 
1410 is connected to the Internet backbone 1402 with a communications link 1408, which also 
represents a geographically local connection. A variety of client devices and non-client devices 
1412A, 1412B, 1412C, 1412D, 1412E and 1412F may be connected below the connection block 
1410. It is noted that interface 1414 represents, for example, a secondary network on which client 
10 devices 1412D, 1412E and 1412F are connected, such as a home network. 

In the embodiment shown in FIG. 14A, web site 1 404 may be desiring to fnovide content that 
is in high demand, over a short period of time. An example of such an event is a live Internet 
multimedia broadcast For such an event, there may; be a huge influx of devices trying to download 
15 the content from the web site 1404 over a short period of time. The web site 1404 may be unable to 
meet this extremely large demand, requiring the web site 1404 to shut down. 

According to the present invention, the web site 1404 may ofT-load some or all of its data 
handling requirements by using the distributed processing system of the present invention for data 

20 caching. The web site 1404 may contact server syst^ 104 and request data caching services. Hie 
server systems 104 may then identify a local machine, such as client device 1412E, to act as a local 
distributor of the content for web site 1404. For exanq)le, one or more idle client devices that have - 
been identified, as discussed above, may be utilized as local distributor client device 1412E. Hie 
local distributor client device 1412E may first download the contentmd pass it on tooths 

25 non-client devices 1412B, 1412C and 1412D through communication links 1416A, 1416B and 
1416C. It is noted that ibis caching will be aided the di^t and non-client devices receiving the 
cached data are relatively short communication hops fiom local distributor client device 1412R 

This data or network caching allows data to be streamed to an end u^ 
30 may then pass the data on to other end user devices. Thus, the downstream communications may be 
limited, thereby taking the distribution burden off of the web site. For exaniple, wi^ site 1404 may 
have a large streaming video or multimedia file that is experiencing a heavy load Snm a given set of 
iietwork devices. This data file may be cached by a machine, sudi as client device 1412E» that is 
below fix>m a communication link 1410. Then, other devices that are also below fiiis cammunication 
35 link 1410 may download the streaming video data^from the client device I412K This caching 
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eliminates the need to rq)eatedly send the same data through the same communication links to 
requesting devices that are located below common communication links. It is noted that the file and 
data distribution possibilities for this pear file access; caching and data transmission, according to the 
present invention^ are wide and varied and should not be'seen as limited to the embodiment shown in 
5 FIG.14A. 

FIG. 14B is a block diagram of a distributed processing system 1450 that provides data 
distribution and data sharing, according to the present invention. As with FIG. 9, FIG. 14B depicts 
an alternative view of a netwoik fabric that may interconnect any of a wide variety of devices. In the 

10 embodiin^t shown in FIG. 14B, server systems 104 are interconnected with any number of client 
systems 108A, 108B, 108C, 108D, 108E, 108F» 108G and 108H. Each of the connecting' 
interconnects represents any of a wide variety of communication links that may exist between 
devices in the network fiibric of die present inv^on. Each of the client systems 108A, 108B, 108C, 
108D, 108B, 108F, 108G and 108H include shared data (SD) according to the present invention. 

15 Within HMs interconnected fiibric^ block 1452 represents data or project infi>rmation that is desired to 
be distributed The SD blocks within each client system facilitates the distribution of this data or 
prqjectinfonnation. ' • 

A client agent, as discussed above, installed on the client systems 108A» 108B, 108C, 108D, 
20 108E, 108F, 108G and 108H includes functionality that facilitates a number of services with respect 
to data transmission and sharing. First, the cli^. agent provides a protected data storage area 
accessible to outside devices, which is represented by the SD block within each client system in FIG. 
14B. This q>ecial storage space protects the device fix>m outside devices accessing other storage 
areas on the device vtdule allowing data to be shared and accessed by other devices and 
25 simultaneously used by the local client agent 

These shared data (SD) blocks provide mechanisms that enable a wide variety of possible 
inteactions aindng the clioDt systrans 108A, 108B, l^ISC, 108D, ld8E» 108F, 108G and i08IL For 
exsaaple, the data sharing medianism may provide a space for a cache of other device addresses 

30 attached to the netwoik for both communication purposes as well as security purposes. The 
mechanism may also provide a single indexing system that is automatically re-indexed wbm content 
is added or removed fixsm the storage area. This inde?dng system may provide a mechanism for other 
client agents to perform discovery on the local blieht information and visa versa. Through 
information stored within this shared data, the distributed processing system of the present invention 

35 &dlitates many distributed file system ^licatiaiis sudi as distributed resume posting, distributed 
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caching, distributed advertisement servmg, etc. In addition to the above, the storage block (SD) 
within each client system may include an inter&ce for displaying or playing data types (such as 
images, audio files, video files, etc.) stored both locally and/or remotely cm other client devices. This 
would enable sinq)le picture sharing, for example^ between remote families connected via the 
5 internet, as part of being a client system within the distributed processing system of the present 
inventicm. 

In the ^bodunent shown in FIG. 14B, data or project 1452 is injected into the fabric 
throng a connection to client system 108C and server systems 104. These connections represent 

10 that ttie information may pass first to server systems 104, or may pass first to a client system, such as 
client system 108C. It is noted that there are oflier ways that the data may be injected into the &bric. 
Once injected, the data 1452 may be transmitted throughout the &bric through any of a wide variety 
of communications, including chent-to-client, serve£4o-client, client-to-server, client-to-non-clioit, 
non-clioit-to-client communications, and/or ncm-client-to-non-chent communications. These 

15 communications may be based upon a variety of mechanisms, such as polling mechanisms and pre- 
assigned firewall ports. This tec^que provides a vehicle that facilitates Ae distributicm of 
infcxcmation to a large number of devices in a short period of time. 

Applications for this data distribution are widely varied. For example, any ixnpoxtmt file that 
20 is time sensitive may be propagated to a large number of cdient devices, non-client devices, servers, 
or other connected devices, in a short amount of time. This transmission may occur quickly and 
efiBciently once the information is injected into the distributed processing system of the present 
inventicm. Example time sensitive data files are anti-virus signature files, vMoh when distributed 
- through the distributed processing system of the present invention,;may be transmitted through the 
25 network fabric fiister than a new virus may ncnmally proliferate. 

Another appUcation for n^cl propagation of iSIes is utili2ang this tecfa^ 
of workloads. One exaiiq>Ie is distributed resume or^'ol) searching. In such a system, participattng 
job seekeris and participating en^ldyers may rapidly search for one another. A job seeker may iigect 
30 a job request or search into the febric tiiat is then roiiited by eadi successive device to other devices 
without the need for control &om the server systebos^ 104. Similarly, an enq>loyer may inject 

canciidate criteria into the febric that is then routed to successive devices. The result is an extremely 

i 

£ist search and identification of employers and candidates. 
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FIG. 15 is a block diagram of an attemathre representation for a distributed processing 
system 100, according to die present invention. SerVer ^ems 104, database systems 1546 and web 
int^&ce 1554 are coupled together through communication links 1540, 1542 and 1544. The web 
interface 1554 includes clients subsystem 1548, task developer subsystem 1550, and advertisers 
5 subsystem 1552, and may include other subsystems as desired. The database systems 1546 include 
workload (WL) information 308, client capability vector information 620, and any other stored 
information as desired Server systems include various inodules and subsystems, including database 
inter&ce 1532, web server 1536, task module and work unit manager 1530, client statistics module 
1534, advertising manager 1538, task module version/phase control subsystem 1528, sweepstakes 
10 engine 1524, server control subsystem 1526, and communication inter&ce 1522. It is noted that in 
the embodiment of a distributed processing system 100 as depicted in FIG. 15, the three primary 
operations for the server systems 104, database systems 1546 and web interface 1554 are directed to 
managing, processing and providing an inter&ce for client systems, customer tasks, and customer 
advertising. 

15 

As discussed above, each client system includes a client agent that operates on the client 
system and manages the* workloads and processes of ^he distributed processing system. As shown in 
FIG. 15, each of the client agents 270A, 270B ... 270C communicates with the server systems 104 
througjh communication links 1516, 1518 ... 1520, re^ectively. As discussed above, any nuniber of 

20 different techniques and architectures may be utilized to provide these communication links. In the 
embodiment as shown in FIG. 15 with respect to client agent 270A, eadi cUwt agent includes a base 
distributed processing system component 1506 and a sepsurate project or woildoad cono^xment 1504.. 
As depicted, a communication interface 1508, a core agent module 1502, and a user inter&ce 1510 
niake up the base distributed processing system cornpcment 1506. The task module 1512 and the 

25 work unit 1514 make up the separate project or woikload component 1504. The task module 1512 
operates on top of the core agent module 1502 to proyide processing of each project work unit 1514. 
It is noted ^ differerit or additioiisd mpddes, snb^fste^ 
tibe client agfflt, as desired. Poor example, a p^rsonsii cdhqp^ 

of the base distributed processing system cQnq)onint jl506 or the separate project or workload 
30 component 1504. 

> 

Also as discussed above, security subsystemsi and inter&ces may be included to provide for 
secure interactions between the various devices and systems of the distributed processing syst^ 1 00. 
As depicted in FIG. 15, a security subsystem and interface 1560 is inteicormected with die server 
35 systems 104, the database systems 1546, the web inter&ce 1554, and the client agents 270A, 270B ... 
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270C. Hiese interconnectiaDS are lepresented by lines 1566, 1564, 1562, and 1568, respectively. 
The security subsystem and tnter&ce 1560 operates to secure the communications and operations of 
the distributed processing system. This security subsystem and inter&ce 1560 also represents a 
variety of potential security architectures, techniques and features that may be utilized. This security 
5 may provide, for exan^le, authentication of devices \^en they send and receive transmissions, so 
that a sending device verifies the authenticity of the receiving device and/or the receiving device 
verifies the authenticity of the sending device. In addition, this security may provide for racryption 
of transmissions between ttie devices and systems of the distributed processing system. The security 
subsystem and inter&ce 1560 may also be implemented in a variety of ways, including utilizing 
10 security subsystems within eadi device or security measures shared among multiple devices, so that 
security is provided for all interactions of &e devices .within tibe distributed processing system. In this 
way, for example, security measures may be set in place to make sure diat no unauthorized entry is 
made into the programming or operations of any'portion of the distributed processing system 
including the client ag^ 270A, 270B ... 270C. 

15 

In operation, client systems or end-users may uiilize the clients subsystem 1548 within the 
web int^ace 1554 to register, set user preferences,.ch6ck statistics, check sweepstakes entries, or 
acconq)lish any other user interface option made available, as desired. Advertising customers may 
utilize the advertisers subsystem 1552 withm the web inter&ce 1554 to register, add or modify 

20 banner or other advertisements, set up rules for serving advertisements, dbeck advertising statistics 
(e.g., click statistics), or accomplish any other advertiser inter&ce option made available, as desired. 
Customers and their respective task or project developers may utilize the task developer subsystCTi 
1550 to access information within database systems 1546 and modules within the server systems 104, 
such as the version^hase control subsystem 1528,th^taskmodule and work unit manager 1530, and 

25 the workload information 308. Customers may also plieck {xcoject results, add new work units, dbsck 
defect reports, or acconq>lish any otter customer oi| de^yelqper inter&ce option made available, as 
. desired. 

Advantageously, the customer or developer may provide tte details of flie project to be 
30 processed, including specific program code and algorithms tiiat will process the data, in addition to 
any data to be processed, hi the embodiment shown in HO. 15, this program code takes the form of 
a task module 1512 within the wrakload, while the data takes the form of wcnic unit 1514. These two 
portions make up the project or workload conqsonent 1504 of eadi client agent 270. For a given 
project, the task module 1512 will likely remain relatively constant, except for version updates, 
35 patches or phase modifications, while the work unit 15 14 will likely chai^ each time processing of 
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the data that it represents is completed. The project or woikload conq)onent 1504 runs in conjunction 
with the base distributed processing system cQnq)onent 1506. When a different customer or project 
is started on a given client system, the project of woridoad conqx>nent 1504 will typically be 
replaced, while fb& base distributed processing system component 1506 will Ukely remain relatively 
constant, except for version iq)dates, patches or other modifications made for the distributed 
processing system. 

Information sent from the server systems 104 to the cliCTt agents 270A, 270B ... 270C may 
include task modules, data for work units, and advertising information. Information sent from the 
cUent agents 270A, 270B ... 270C to the server systems 104 may include user information, system 
information and capabilities, current task module v^ion and phase information^ and results. The 
database systems 1546 may hold any relevant info^nation desired, such as workload information 
(WL) 308 and client c^bility vectors (CV) 620. Exanq)Ies of infommtion that may be stored 
include user information, client system information, client platform information, ta^ modules, phase 
control mforxnation, version information, work units, data, results, advertiser information, 
advertisement content; advertisemmt purchase information, advertisement rules, or any other 
pertinent information. 

Now looking to FIGS. 16, 17A, 17B, 18A and 18B, an embodiment for security features for 
the distributed processing of the present invention will be described. FIG. 16 provides a 
represmtation of the distributed processing environment including security subsystems* FIGS. 17A 
and 17B provide block diagrams of die communication interface between client systems and the 
server systems. And FIGS. 18A and 18B provide ^detailed block diagrams of an enibodimCTt of 
security measures for the server systems and the client systems. 

Referring to FIG. 16, an embodiment 1600 pf a distributed processing system is depicted. 
Server systems 104 include a security subsystem 354 thrbu^ which communications to and from the 
server systems 104 may be made secure. Client sy^inis 108A, 108iB ... 108C and client systmis 
lOSD, 108E ... 108F represent any number of clieiit systems that may cormnunicate with server 
systems 104 or with each other. Each of the client syi^jtems 108A, 108B, 108C, 108D, 108E and 108F 
include a security subsystem 272A, 272B, 272C, 27215, 272E and 272F, respectively. The electronic 
information 1602 represents information that the server systems 104 is to communicate to client 
systems 108A, 108B, 108C, 108D, 108E and 108F in a secure manner, sa tiiat no unintended* or 
intercepting recipient may understand or isanpor with the electronic information 1602, and so ^t no 
third party may insert non-autiiorized information into the distributed processing system 1600. 
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Although not shown, it is understood that any one of the client systems 108A, 108B, 108C, 108D, 
108E and 108F may have electronic information that is to be securely sent to the server systems 104 
or to any other of the client systems 108A, 108B, 108C, 108D, 108E and 108F. 

5 Electronic information 1602 represents information that is communicated to fedlitate the 

operations of the distributed processing systm 1600. Such information includes the client agents 
that are downloaded to each client system, the workload applications for any given workload, and 
any work unit that will be processed by a client system. Electronic information 1 602 may also be any 
type of information to be sent or received within the distributed processing system, such as text, 
10 images, audio streams, video streams, databases, spreadsheets, PDF files, Shockwave data. Flash 
data, applications, data files, chat streams, or any other information, data or data streams. In 
addition, electronic information may be sent by client systems 108A, 108B, 108C, 108D, 108E and 
108F to the server systems 104 and/or any of the other client systems. 

15 The Cotificate Authority (CA) block 1604 within flie servi^ systems 104 represents an entity 

that helps to ensure validity of encryption and decryption codes. For example, within a 
public^rivate key encryption environment, a Certificate Authority may help ensure that a public key 
alleged to be firom a particular entity is in fact legitimately from that entity. One third-party entity 
tiiat performs this CA fimction on the Internet is Verisign, Inc. Having a third-party perform the CA 

20 fimction can be advantageous in a transacticm or communication between non-trusted entities. For 
example, the smding entity provides its public key information to the third-party CA, which verifies 
the information and creates a certificate tiiat includes the sending entity's public key information. 
This certificate may then be encrypted and signed by the durd-party CA. The receiving entity may 
then obtain the certificate fit)m the fliird-^party CA and decrypt it with the third-party CA's public 

25 key. The receiving party will then have the sending party's public key and be fairly secure that it is a 
legitimate public key fit>m the sending party. 

As shown in FIG. 16, tiie CA fimcticmality nky be of the server systems 104, such that 
the server systems 104 act as fbek own Certificate Authority with reject to client systemsl08A, 

30 . 108B, 108C, 108D, 108B and 108F and any o&er devices that are part of the distributed processing 
system. A third-party CA is not as needed in this distributed processing environment because the 
server systems 104 primarily direct the qierations of the distributed processing system. Thus, there 
is less of a need for a tfaiidrparty entity to provide a CA fimction. It is noted that CA fimctionality 
may be provided only by the server systems 104, only by third-party CAs, or any ccnnbuiation of 

35 server systems 104 and third party CAs, as desired-for a particular embodiment In addition, if 
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desired, no CA functionality could be provided so that, secure conununications between the serv^ 
systems 104 and the defaces within the distributed processing system w^ conducted without the use 
of a CertijScate Authority. 

5 FIG. 17A is a block diagram of an ^bodimrat 1700 for a communication interface between 

a client system 108 and the server systems 104. In this embodiment 1700, the network is prefi^nbly 
the Internet As depicted, the client system 108 includes a client a^nt 270 and a network browser 
1702. The server syst^ns 104 include a client ageait download site 1710, from which the client 
system 108 may download the client agent 270 through communications 1704. The servo: systems 

10 104 also include block 1712, which rq)r6sents a variety of client service functions diat may be 
jxrovided by the web interface for tihe server ^stems 104 through communications 1706. For 
exanq>le, in a public^vate key security environment a client system 108 may download fixnn block 
1712 a Certificate Authority (CA) certificate tiiat includes the server public key. In addition, the 
client system 108 may login to the web p£^e inter&ce for the server systems 104. And tiie server 

15 systems 104 may gen^te dynamic c^ficates. Ti^ client system 108 may also send and receive 
information to q;)plication server 1714 through communicatians 1708, for exanq)le, to receive project 
work units. Finally, as depicted, database systems 1546 may send information to and receive 
information &om tiie blocks 1710, 1712 and 1714 of the s^er systems 104 through communicaticHis 
1716, 1718 and 1720. As discussed more above, database systems 1546 may include any desired 

20 information, for oample, a worldoad database 308 and/or a capabihty vector database 620. 

i'; 

FIG. 17B is a block diagram for an Ihtmiet communication protocol structure 1750 that may 
be utilized for communications 1704, 1706 and 1708. As depicted in FIG. 17B, three basic 
application layers are utilized by each client system 1 08 (and flie server systems 104 to communicate 
25 with each other. The TCP/IP layer 1756 represents a standard Internet communication protocol that 
allows devices to identify and send information to each otiier across the hitemet, as is well known to 
those ofskillin-the art The secure n^wodc layer (SfjL)^^^ 
ri5[»«sents a protocol that aUow^ 

whom they communicate, as los^ as those servers or other devices iitiliase similar protocols. The 
30 application security level 1752 rq>resents other desired security or conmxunication protocols that are 
implemented by progranas running on the client system 108 and/or the server systems 104. 

In operation, the server systems 104 may secure the download of the client agent 270 to the 
client system 108 by requiring that the client systepbi 108 download the client agent 270 fixnn the 
35 client agent download site 1710. As part of tiie server authentication sequence, the download site 
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1710 will send back an identifier to assure users that they are indeed connected to (he proper server 
systems 104. This identifier mscy be, for example, a CA certificate, but may be any odier identifier, 
as desired. Because it is desirable to have the client agent running on as many distributed devices as 
possible for the distributed processing system of flie present invention, user authentication nmy not 
be required to download the client agent 270 fiom the download site 1710. 

Once a client system 108 has downloaded and installed the client agent 270, the client system 
108 will communicate with tiie q)plication server; 1714 to begin woiking within the distributed 
processing system. For Uiese communications, server and client authentication may be required to 
help ensure security. To accomplish dais authentication, for exanq>le, two-way authentication may be 
utilized. To provide a public/private key combinatioii for the client agent 270, each client agent 270 
that is downloaded by a client system 108 naay have embedded within its code a default identifier and 
a de&ult public^private k^ pair. Thus, the server systems 104 may use secure network jnrotocols 
(sudi as SSL or similar schemes) to authenticate each dient system 108, and each client system 108 
may use conq>atible protocols to authenticate each Server application with i^ch it communicates. 
These sq)plications, for exaniple, may include the fioictionality provided by blocks 1712 and 1714, 
and, therefore, the communications 1706 and 1708 would utilize authentication. 

As an attemative to embedding a public^vate key combination and associated identifiers or 
certificates into the client agent 270, the public^irivate key pairs may be (fynamically generated in 
block 1712. For example, at'start-t^, at reboot or aSi some desired time or event, the client system 
108 may generate a new public/private Isey pair. Wh^ the cUent system 108 next communicates 
with the server systems 104, the client system 108 request a certificate from the server systems 104. 
The server systems 104 may flien act as a Certificate Authority (CA) and provide a CA colificate to 
the client system 108. This dynamic certificate gen^tion, therefore, allows for added security by 
allowing each client system 108 to have its own pubiic/private key pair for secure network protocol 
coimnunicatiQns and by having this key pair chan^ at^some desired recurrii^ event for the client 
system 108, such as reboot I 

The client system 108 may initiate its commiinication with flieserv^systenis 104 by logging 
on to the authentication server, which may be part of block 1712. The user may be prornpted to enter 
a valid e-mail address and/or password, if abeady registered, or may be asked to register if the e-mail 
address and/or passwoid are not recognized. Once i^gistration is completed, a password may be e- 
niailed back to .the user to provide validation of the i^er. If authentication is successfid -vrfien a user 
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logs into the server systems 104, the server systems 104 may provide a host-ID, and user-ID and a 
session key for any given communication session. 

It is also desirable that once a user has successfully registered, the user may install the client 
5 agent 270 on any number of other host or user systems without needing to interact with that systems 
network browser, other than to set host-specific preferences. For exanqple, when downloaded, the 
client agent 270 may take the form of a self-extracting program that installs the appropriate files to 
the client system 108, including the proper host and user identifications. In addition, to help ensure 
proper identification, die session keys may be ^changed each time the client syst^ 108 

10 communicates with the server systems 104. For example, fiie client system 108 may communicate its 
current session key to the server systems 104 each time it communicates with the server systems 104. 
The server systems 104 will then send a new session key for flie client system 108 to utilize for the 
next session, hi this way, stale identification infohnation may be reduced. In addition to this 
security feature, conmiunications may also be encrypted and decrypted with various encryption 

15 techniques, as desired. 

Referring now to FIGS. 18A and 18B, one^ embodiment will be discussed for a security 
model utilizing public^rivate key encryption. This security model utilizes a third^party CA to 
provide a CA certificate for the server systems 104. 

20 

k 

FIG. 18A is a block diagram of an embodiment 1800 for security procedures inq>lemented by 
server systems 104. Electronic informationl6Q2 is .to be commimicated to a client system 108. This 
electronic information 1602 travels duough four difierenf paths that provide security information. 

25 One padi begins with the electronic infcnmatibn 1602 being encrypted with the serv^ private 

key in block 1802. Then, in blodc 1830, the ^crypted,information is sent to client systems. This 
encrypted irifonnation is rqsresented by arrow 1826. • 

A second path flows from block 1802 to block 1804 where a 1^ 
30 encrypted electronic information. It is noted that a hasli value is a unique value that may be 
g^erated for any givra electronic file based iqpon the contents of tibat file and the algorithm used to 
calculate the unique value. There are any iiuniberofdgOrithinsfimtinay be used to calcula^ 
value, as would understood by one of skiU in the sul , I^eeding dc^ 
1806, the hash value generated on the server side for the encrypted electronic information (i.e., the 
35 information sent to the client system fiom block 183Q visi 1826) is conq>ared with a hash value 1822 
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fiom the client system 108. This hash value 1822 represents the client system's calculation of the 
hash value for the encrypted electronic information that the client system 108 received fiom the 
server system 104. If no tampering has occurred and the data was transmitted accurately, the client 
system hash value should match the server hash value. In block 1808, the seSrver systems 104 provide 
5 an indication of the result of the hash check evaluation back to the client system 108. This pass/&il 
determination is indicated by arrow 1824. 

• • i . ' 

A third path begins with block 1810 where a hash value is calculated for nonrcncrypted 
electronic information 1602. This hash value is thenienqypted.in block 1816 with the server private 
10 key. Next, dns enoypted hash value is sent to the client system 108 in block 1818. The arrow 1821 
represrats the encrypted hash value for the non-encrypted electronic information. 

A fourth path, and ihe last depicted in &e embodiment 1800' of FIG. 18A, flows fiom block 
1810 to block 1812, where the hash value is partitionied into N difierent portions. These N different 

15 portions are preferably designated for N different client systems 108, as well as any client systems 
108 receiving a redundant distribution of any one of the N different portions. In block 1814, die N 
different hash value portions are encrypted with the server private key. Next, the'N different 
encrypted hash value portions are sent in block 182b to N differrat client systons 108, as well as 
being sent to client systems 108 receiving redundant distributions of the hash value portions. The 

20 arrows 1828 represent the distribution of the N different hash value portions. It is noted that 
redundant distribution of Oie N hash value portions^is desirable because, as discussed below with 
respect to FIG. 18B, when the hash value is reconstructed by a client syst^ 108, it is desirable to 
have multiple sources for each portion in case one of the receiving client systems is not available at 
any given tune. ; 

25 

Looking now to FIG. 18B, the correspcmding security procedures iniplemented by a client 
system 108 are discussed with respect to embodiment 1850. Initially, in blodc 1854, the client 
systom 108 xecdvesCA certificate 1852 cc^ Itis 
again noted that oth^ unique identifiers may be utilized instead of CA certificates, as described 

30 above. If a CA certificate is utilized, this CA certificate may be provided fiom a flnrd-party 
Certificate Aufliority (CA) or fiom tihe serv^ systems 104 or any other desired source. Jn block 
1856, die client system 108 verifies the accuracy of the CA certificate usix^ the CA's public key. If 
. this verification is not successfiil, tfie client system 108 may wait some period of time before 
retrying. In addition^ the time period imr/ be a randoidi pipod of In addition, as discussed with 

35 respect to FIGS. 17A and 17B, the client system 10$ will logm to the server systems 104. If this 

-52^. * 



wo 01/73545 PCTAJSOl/10060 

auihenticatiaa is not successM in this login, the cUent system will notify fee user of flie system and 
the server systems 104, and then wait for some period of time or a random amount of time before 
attenq)ting to re-verify. 

5 In block 1862, the client system 108 receives the encrypted information 1826. Nejrt, flie 

client system 108 creates a hash value for the encrypted: information in block 1864. This hash value 
is preferably calculated using the same algorithm utiUzed by die server systems 104 in generating the 
hash value for the encrypted information in block 1804 of FIG. 18A. Once die client system 108 has 
calculated the hash value for die encrypted information, this hash value 1822 is sent to the server 

10 systems from block 1866. As discussed above, a pass/feil response 1824 is sent bade by the server 
systems 104. Ihis hash check evaluation is received inblock 1868. If the check was a FAIL, flow 
passes to block 1870 \tdbere the client system 108 sends out a notice to the server systems 104 and 
any other client system to which it is attached diat a problem has been encountered. The client 
system 108 then ends the current connecticm with the server systems 104. It is noted that die client 

15 system 108 may retry several times before moving onto block 1870, and that die reporting scheme 
may be modified, altered or developed as desired. 

If the hash check evaluation was a PASS, flow passes to block 1872 whm die electronic 
information is decrypted with the server public key, which was verified in block 1856. A hash value 
20 is dien calculated for the electronic information 1874 Again, tiie hash generation algorifimi is 
preferably die same as that used by the server system$ l(k in creating the hash value in block 1810 of 
FIG. 18A. Next, the hash value is sent Scorn block 1874 to block 1886, vdiere it is compared with 
two other hash value calculations. , 

25 One of die other hash values comes fix>m a path diat begins with block 1858, in which die 

client system 108 receives die encrypted hash value 1821 for the non-encrypted information. In 
block 1860, the encrypted hash value is decrypted with die server public key. The hash value is then 
sent to block 1886. 

30 Hie diird hash value for block 1886 comes from a path that utilizes the N dififerent hash 

portions sent out by the server systems in block 182(^ of FIG. 18A. In block 1876, die client system 
receives a portion 1828A of the partitioned hash value 1828. In addition to one of the partitioned 
hash values, it is noted that the server systems 104 will also send information providing the identity 
and source for the N-1 other hash value portions. In block 1878, the client system 108 decrypts the 

35 portion 1828A with the server public key. Next, in block 1880, the client system 108 resolves the 
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identity of the source for fee N-1 other portions, which may be N-1 other client systems. In block 
1882, the client system 108 obtains the N-1 oflier portions, and assembles flie N partitions into a hash 
value for the non-encrypted electronic uiformation in block 1884. The resulting hash value is then 
sent to block 1886. It is noted, as indicated above, that redundant distribution of the N portions of the 
5 partitioned hash value is desirable so that unavailability of one client system will not cause another 
clirait system to be unable to re-assemble the N difTeient portions. 

Once flie three hash values are received in block 1886 frran three differoit sources, fliey are 
compared to see if they match. If this check is a FAIL, flow moves to block 1888, where the client 

10 system 108 sends out a notice to the server systems: 104 and any other client system to winch it is 
• attached that a problem has been encountered. The client system 108 may also inform the client 
systems fiom which it received the N-1 other portions, and the client Systran 108 may retry the 
procedures, if desired. In addition, once a client system 108 is notified of a potential problem, the 
client system 108 may download a special check file fiY)m the server systems 104 to make sure that 

15 flie server systems have not been compromised. If still a FAIL, the client system 108 then ends the 
.current connection with the server systems 104. If the check is a PASS, the electronic information is 
utilized, as represented by block 1890. 

FIGS. 19 and 20 provide block diagrams for ftrther describing the distributed processing 
20 system and environment of the present invention that allows for third parties, such as netwodc service 
providers, to monitize, or gain revenue fit>m, their respective us^ bases. 

Looking first to to FIG, 19, a block diagram is depicted for a distributed processing system 
100 and environment 1900 in which network service providers are enabled to monitize their user 

25 bases, aiviromnent 1900 includes a distributed processing system 100, a customer 152, and a third- 
party network service provider 1902. The customer 152 rqiresents an entity that has a project 1912 
that &e customer 152 would like processed by the distributed CQiiq>uting system 100. In return for 
the processing of the project data and the results 1914 offliis processing the customer 152 will often 
make a payment 1916. The third-party network service provider 1902 maintains a user database 1904 

30 that identifies its user base 1920 including users 1906A, 19066 ... 1906C. 

The service provide 1902 may be, for example, an Internet business that provides any of a 
variety of services to uscts, such as Jtotemet access, e-mail, web page hosting, domain name hosting 
file sharing services or any other Internet-based service. In addition, such Intemet-based services 
35 may be offered for fitee or low cost to users, in which case the users have historically agreed to view 
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banner or other advertisements in return for the firee or low cost service. However, as stated above, 
advertising revenue has been subject to diminished pricing and has become a unreliable source of 
revenue for many Internet-based companies. To facilitate the number of projects that the distributed 
processing system 100 can take on and the speed at which these projects can be processed and 
5 completed, it is desirable to increase the amount and capabilities of the computing resources 
available to the distributed processmg system 100. To the extent that ttie users of the service 
provider 1902 represent a pool of underutilized resources, these users represent a pot^tially valuable 
resource to the distributed processmg system 100. 



10 According to the present invention, the service provider 1902 may realize value from its user 

base and thereby monitize this user base by facilitating the use by the distributed processing system 
.100 of computing resources related to these users. Thus, for example, in return for free services, the 
users may agree to have their respective computing resources utilized by the distributed processing 
system 100. The service provider 1902 may then provide to the distributed processing system 100 

15 flie user identifications (IDs) 1908 related to its user base in return for revenue sharing 1910. This 
monitizing architecture according to the present invention thereby provides a significantly 
advantageous avenue for service providers or other entities that control or have user bases with useful 
processing capabiUties, such as Internet-based service providers, to generate revenue from its user 
base, particularly in the face of falling rev^ue from Other sources, such as advertising revenue. 

20 

The revenue sharing 1910 may be, for example, a share of payment 1916 relative to the 
amount of processing toward the project 1912 that was completed through the use of the user 
resources 1922 made available through users 1906A, 1906B ... 1906C, It is noted that the revenue 
sharing 1910 may take any desired form, including but not limited- to (a) upfront payments based 
25 upon attributes of the user base, such as size or processing capabilities, (b) payments based upon the 
number of users that become members of the distributed processing system, (c) payments based upon 
the types of projects processed by the user base, or (d) any other desired compensation scheme 
related to the value of the user base being made available by the third party. 

30 The monitizing invention, therefore, focuses on c^abiUties of internet, intranet, wireless or 

otherwise network connected PCs, mtemet appHances, notebook computers, servers, storage devices, 
NAS (Network Attached Storage), or any other connjpcted conqjutmg device that could provide any 
of a number of usefiil capabilities and that is part of a underutilized user base, such as user bases of 
Internet-based busmesses that rely on advertising or any . other method of monitizing tiieir user base 

35 in exchange for a valuable service (e.g. free intemet access, email, etc.). As discussed above, these 
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usefid processing capabilities span the entire range of generic computing subsystems including: 
Central Processing Unit(s) (CPUs), Digital Signal Processor(s) (DSPs), Gnq)hics Processing 
Engine(s) (GPEs), Hard Drive(s) (HDs), Memory (MEM), Audio Subsystem(s) (ASs), 
Communications Subsystem(s) (CSs), Removable^ Media TVpes (RMs), or other Add-In/On 
5 Accessories (A/OAs) with potentially useful unused capabilities. Market creation and potential 
compensation for all unused capabilities can be 'accomplished through the massively parallel 
distribitted software architecture of the distributed processing system 100. For exan^le, credits 
(revenues) would be generated each time a unit of work is accomplished by one (or more) of the 
subsystems on a user's computing device via a client agent installed on the device for the purposes of 
10 managmg, processing and convicting units of work. The total credits/revenues generated may be, 
for exan:q>le, dynamic depending on how many are received. Throu^ tihis architecture of the present 
invention, significant revenues may be generated firoin the user base of the service provider wh^e the 
service provider may have previously been unable to monitize effectively fbis user base. 

15 ' It is further noted in more general req)ects that the entity 1902 may be any entity fbat has 

direct or indirect control over a ffovp of users, sucKthat &e users resources may be offered to and 
utilized by the distributed processing system 100. "^Ah example of one sudi more general entity 
would be a company that has a large group of internal ^ers that are capable of being linked to the 
distributed processiiig system 100, for exanq)le, throi^ghvan intranet network of conqmter systems or 

20 computing devices. The conq)utiag resources related^to these users may also be monitized according 
to the present invention. 

Looking now to FIG. 20, a block diagram for an embodhnent 2000 represent!!^ the 
cdnq)Qnent5 for a client agent 270 along with a representative indication of responsibility for those 

25 components. Client agent 270 includes a core agent cjoniponent 1502, a project component 1504 and 
a user inter&ce component 1510. As discussed above, the core agent component 1502 can provide 
the base distributed processing functionality for the client agent 270. The project compoiieixt 1504 
can ptovide the proje6t-specific functionality for thelblieht agetit 270. And the liisar int^c&ce 15l6 
can provide any desired user viewable infonziation of int^^ These three gen^ 

30 components may be modular software conq)onents ^ch that flie project component 1504, the core 
agent component 1502, and the user inter&ce component 1510 may be separate software modules, if 
desired, that link together through q>propriate APIs' (Ajpplication Programming interfiu^e). Ibus, 
each of these conqponents may be designed and developed independently or jointly, as deshed. In 
efifect, the core agent conq)onent 1502 can provide a backbone upon vMck is attached the project 

35 component 1504, the user intec&ce conqninent 1510, and any other desired cornponent Thus, yfbsa 
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a new project or interface is desired for any given client agent 270, for exan:Q>le, this conqxment may 
be efficiently replaced with the new component in a modular feshion still uttlizing the core agent 
component 1502 as the backbone. In addition, each component may be updated and modified 
without requiring modification or updates to the other co]iq)onent software code. 

Also depicted in FIG. 20 are customer 152, distributed processing system (DPS) 100 and 
service provider 1902, which are in communication wifli each other through interactions or inter&ces 
2012 and 2014. Jn this embodiment of FIG. 20, the customer 152 is rqrosented as providing the 
software developmrat and code 2002 for the project conqKment 1504. The distributed processing 
system 100 is rqjresented as providing the core agpnt code 2008 for the core agent co^^ 1502. 
And the service provider is represented as providing at least a portion of the interface development 
and code 2010 for the user inter&ce conq)onent 1510. In (q)eration, the woridoads 2004 and tibe 
results 2006 would still typically be under the control of the distributed processmg system 100. 

It is noted that this modular architecture fecilitates the development of project software code 
and interface software code by entities other than the owher of the distributed {urocessing system 100. 
For example, with req>ect to FIG. 19» an Internet-based service provider may have a viser interface 
already designed and implemented for its user base, such as k web browse user inter&ce for users of 
free Internet access services provided by such a service provider. Once the core agent coaq;x>nent 
1502 is installed on a user's computer, the existmg third^part/ user inter&ce may hook into the core 
agent conq)onent 1502, thereby making the user's resources available to the distributed processing 
system 100, \^e maintaining the user inter&ce the user has come to CTipect fiom the service 
provider. Thus, the service provider 1902 may provide the user interfece it desires for the service it 
is providing, while at the same time mcmitiztng its user base by feciUtating its users becoining part of 
the available resources for the distributed processing system 100. 

Further mocfifications and altmiative embod^en 
skilled in the sirt in view of this description. It \yill be recognized, therefore, 1^ the pre^^t 
invention is not limited by these example arrangements. Accordingly, this description is to be 
construed as illustrative only and is for tiie purpose of t^ching those skilled in the art die manner of 
carrying out the invention. It is to be understood fliat the forms of the invention herein ^own and 
described are to be taken as the presently preferred embodiments. Various changes may be made in 
the shape, size and arrangement of parts. For exanq)le, equivalent elements be substituted for 
those illustrated and described herein, and certain features of the invention may be utilized 
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independently of the use of other filatures, all as would be apparent to one skflled in the art after 
having the benefit of this description of the invention. 
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1 . A massively distributed processing system, comprising: 
at least one server system coupled to a networlq.and 

a client agent program configured to operate on a multitude of mdely distributed devices 
coupled to the network, &e client agent program conqnising: 

a processing system component conqdsing a core agent module, Ifae core 
ag^t module being configured to operate with any of a plurality of 
different task modules; and 
a separate project componoit conq)rising at least one project task module, 
each task module being configured to run on top of the core agent 
module and to process distributed project workloads for at least one 
distributed processing project 
the server system being configured to provide the conqxments of (he client agent program to 
the distributed devices and to provide distributed woildoads to tbe distributed 
devices. 

2. The massively distributed processing system oi* claim 1, wherein the project component of 
the agent program includes a plurality of di£ferent task modules. 

3. The massively distributed processing system of claim 2, wherein the network conqnises the 
Intemet. 

,*•* 

4. The system of claim 1, further comprising: 

a c^ability database coupled to the server system^ the capability database storing workload 
capability factors for the distributed devices; and 

an incentive database coiq)led to the server system, the inbfentive database storing incentive 
values for the distributed devices, the ^rver system utilizing the workl<»d capability 
factors to determine the incentive values for the distributed devices. 



5. The system of claim 4, wherein the incentive values are based iq)on the woddoad completed 
by the distributed devices. 
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6. The system of claim 4, whetein tiie incentive values are based upon the woridoad aqpatnlities 
of the distributed devices. 



7, 



The system of claim 1, ftnther conqmsing: 

a capability database coi^led to the server system, the capability database storing workload 



5 



capability factors associated with Ihe distributed devices; and 
a sweq)stakes database coupled to the server system, the sweq)stakes database storing 



entries associated with the distributed devices. 



10 



8. The S3rstem of claim 7, wherein die server system utilizses the woridoad capacity &ctoi8 to 
determine Qitiy values for the pluiaUty of distributed dey^ 



9. The system of claim 7, wherein the entiy values aie based upon the woridoad completed by 
the distributed devices. 



15 



10. The system of claim 7, wherein the entty values are based upon the woikload capabilities of 
the distributed devices. 

1 1 . Hie system of claim 7, wherein woridoad capability Victors for the distributed devices aie 
20 determined by a benchmaric woridoad 

12. The system of claim 1, further comprising a capability database coupled to the server system, 
the capability database storing woridoad capability factors associated with the distributed devices. 

25 1 3. The system of claim 12, wherein the woridoad capabihty factor for the distributed devices 
represents the workload actually performed by the distributed device. 

14. The system of claim 12, wherein the workload capability fiactor for the distributed devices is 
determined by a benchmark workload. 

30 

15. The system of claim 12, wherein the workload capability factor for the distributed devices is 
determined by the workload capabiUties of the distributed devices. 
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16. The system of claim 1, further conqprising a cs^abilities database storing worldoad 
c£q)abilities for the distributed devices, the server system utilizing the woridoad capabilities to 
schedule a distribution of workloads to the distributed devices. 

17. The system of claim 16, wherein the woddoad capabilities are rqnresented by a set of 
cq>ability vectors for die distributed devices. 

19. The system of claim 16, wherein the vectors comprise BIOS support capabilities, CPU 
support capabilities, graphic siqsport capabilities, storage c^abilities, cormnunication support 
capabilities, memory capabilities, or operating system c^abilities. 

20. The system of claim 16, wherein workloads are allocated in at least part based xxpm 
woridoad requirements and the worldoad c£q;)abilities of the distributed devices. 

21. The system of claim 16, wherein the woridoacl capabilities for the distributed devices are 
determined by a benchmaric woridoad. 

22. The system of claim 1, fiirdier comprising a workload database coiq^Ied to Ae server system 
storing workloads for network site testing, the server System scheduling the site testing workloads for 
ttie distributed devices to test content delivery for a network site. 

23. The system of claim 22, wherein flie site testing is quality of service testing, load testing or 
denial of service testing. 

24. The system of claim 22, further conqnising a capabilities database coupled to the server 
system storing workload capabilities for a plurality of the distributed devices, fhe s^er syst^ 
utilizing the workload capabilities to schedule site testing woridoads for the distributed devices. 

25. llie system of claim 22, i^erein die incentive value is based at least in part u^^ 
workload capability of the distributed devices. 

26. The system of claim 1, further comprising a woridoad database coupled to the server system 
storing workloads for network site content indexing, the server system distributing the inrf^Yi'tig 
workloads for the distributed devices to mdex content ;deliveied by network sites. 
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27. The system of claim 26, fiirther coiiq>xising a renting index stored at least in part on die 
sorvor system. 

28. The system of claim 26, further con^rising a resulting index stoied at least in part on a 
5 plurality ofthe distributed devices. 

29. The system of claim 26, further coiiq)rising a capabilities database coupled to the server 
system storing woddoad capabilities for a plurality ofthe distributed devices, the server system 
utilizing the workload capabilities to schedule inducing woridoads for &e distributed devices. 

10 

30. Tb& system of claim 26, further conpising an incentive database cottpled to Ae server 
system storing incentive values for a plurality ofthe distributed devices, the incentive values being 
provided to couple &e distributed devices to the server system fliroug^ the network so that tfie 
distributed devices are capable of performing a portion ofthe indexing workload. 

15 

31. The system of claim 1, further conpising a vi^orkload database coiq>Ied to the server system 
storing wcnkloads for data back-iq>, the server system^cheduling the data back-iq) workloads for the 
distributed devices to back-up data coiq)led to the network. 

20 32. The system of claim 31, \fdierein the back-up datsi workloads include redundant workloads so 
that any given portion ofthe back-up data is stored on at least two different computer systems. 

33. The system of claim 3 1, further comprising a c^bilities database coiq>Ied to die server 
system storiiig workload capabilities for a phirality ofthe distributed devices, the servo- system 

25 utilizing the workload Capabilities to schedule data back-up woildoads for the distributed devices. 

34. The system of claim 31, further con^rising aii incentive^c^ 
systdin storing incentive values for a plurahty of tb 

provided to coiqile the distributed devices to the server system through the network so that the 
30 distributed devices are cq>able of performizig a pca^tioi of the data back-up workload 

35. The system of claim 1, further comprismg a database coupled to the server system, the 
database storing user selected operating parameters for tiie distributed devices, the user selected 
operating parameters being utilized to schedule project wdikloads for the distributed devices. 

35 
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36. The system of claim 35, wherein the operating parameter comprises an a£Bliation indication. 



37. The system of claim 35, wherein the operating parameter conq>rises a project type indication. 

38. The system of claim 35, wherein the operating parameter further conq}rises apercentage 
indication that allocates processing capabilities of a distributed device between selected projects. 

39. The system of claim 1, further comprising a database coupled to the server system and 
storing idleness vector data for a plurality of the distributed devices, the server system utilizing the 
idleness vector data to identify relatively idle distributed devices and to schedule a distribution of 
workloads to the distributed devices based at least in part upon the idleness identificatiorL 

40. The system of claim 39, wherein process mteosive workloads are scheduled to idle 
distributed devices based iqm the idleness id^Dtificafo^ 

41. The system of claim 1, fiirther comprising a database coiq)led to the server system and 
storing capability data for a plurality of the distributed devices, the server system utilizing flie 
capability data to aggrepte c^abilities from at least two distributed devices. 

42. Hie system of claim 41, wherein a storage deyice on a server distributed device and a 
processing device on a second distributed device are aggregated capabilities. 

43. The system of claim 1, further canpdsing a sweq)stakes database coupled to the server 
Systran, the sweepstates database storing madiine gyrated entries associated wi & the distributed 
devices. 

5 

44. The system of claim 43, wherein the machine^gaierated entry comprises results fiom an 
^otry i;(^dd(kd sent fiom 

45. The system of claim 43, ^rfierein the client agent is configured to s^id to flie server system 
the machine generated entries. } 

46. The system of claim 1, wherein a plurality of the distributed device^ have information stored 
in shared data storage, the distributed devices allowing client agent programs <m other distributed 
devices to access the shared data storage on the distributed devices. 
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47. The system of claim 46, vAxcrein tiie information stored comprises information to J&dlitate 
communication between multiple distributed devices. 

48. The system of claim 46, wherein the information stored con9)rises information to fiicilitate 
processing of workloads by the disbributed devices. 

49. The system of claim 1» wherein a phirality of the distributed devices have stored information 
that facilitates data distribution by tiie client ag^ programs. 

50. The system of claim 49, wherein tiie information stored composes information to £icilitate 
distribution of time sensitive data. 

51. The system of claim 49, ;v^erein the information stored on each distributed device comprises 
communication addresses of other distributed devices, ttie communication addresses allowing for 
rs^d peer-to-peer communications. 

52. The system of claim 49, wherein the distributed woridoads comprise data caching workloads, . 
and wherein the information stored conpises cached, data to be retransmitted to other distributed 
devices. 

53. The system of claim 1, further comprising a database storing capability vectors for a plurality 
of the distributed devices, and wherein the server system is configured to utilize at least one 
capability vector to identify at least one distributed device to accomplish a data conversion task in 
response to a data conversion request from a requesting device. 

54. The system of claim 53, wherein the data conversion task conoprises language translation or 
reformatting content of a network site. 

55. The system of claim 1 , further comprising a database storing attribute information for the 
distributed devices, the server system utilizing at least one device attribute to identify a subset of the 
distributed devices. 

56. The system of claim 55, wherein a project workload is distributed to the subset of distributed 
devices. 
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57. The system of claim 55, v^eiein the attributes coiiq)rise infcmnatiQn conceming users of the 
distributed devices and wherein the utilized attribute comprises user information. 

• 5 58. Hie system of claim 57, wherein an advertisement is distributed to the identified subset of 
distributed devices. 

59. The system of claim 55, i^erein the utilized device attribute comprises an attribute selected 
by a customer. 

10 

60. The system of claim 1, further comprising a secimty subsystem within the server system 
having as an output at least one paititionable security measure for electronic information that is being 
provided to at least one distributed device, the paxtitionable security measure beic^ distributed to 
multiple distributed devices and having to be reconstiucted by at least one distributed device to 

15 confirm the security measure. 

61 . The system of claim 60, i^erein the security measure conq^rises generating a hash value for 
the electronic information and wherein the hash value is partitioned into N portions and distributed to 
N different distributed devices, including the distributed devices that are 

20 infomiation. 

62. The system of claim 60, whorein the electronic information conq>rises a project workload. 

63. The system of claim 1, wherein a portion of the plurality of distributed devices conqnise 
25 devices ^sociated wifli users firom a third-party user base and wherein project revenue &om 

processing customer project workloads is shared wifhithethird-party in relation to resources of the 
utiUzed third-party user base. 

64. The system of claim 62, wherein the cUent agent fiirtherccmip^ 
30 component 

65. The system of claim 64, wherein the project con^ment software is own 

the core agent coa^neat software is owned by the owner of the distributed processing system, and 
the user interface conoponent is owned by the third party. 

35 
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